Nov 06 14:20:09 devstack cinder-volume[75444]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 14:20:09 devstack cinder-volume[75444]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 14:20:09 devstack cinder-volume[75444]: we strongly recommend against using it for new projects. Nov 06 14:20:09 devstack cinder-volume[75444]: If you are already using Eventlet, we recommend migrating to a different Nov 06 14:20:09 devstack cinder-volume[75444]: framework. For more detail see Nov 06 14:20:09 devstack cinder-volume[75444]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 14:20:09 devstack cinder-volume[75444]: import eventlet # noqa Nov 06 14:20:11 devstack cinder-volume[75444]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75444) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 14:20:11 devstack cinder-volume[75444]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75444) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 14:20:11 devstack cinder-volume[75444]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75444) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 14:20:12 devstack cinder-volume[75444]: INFO dbcounter [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Registered counter for database cinder Nov 06 14:20:12 devstack cinder-volume[75444]: DEBUG oslo_db.sqlalchemy.engines [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75444) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 14:20:13 devstack cinder-volume[75444]: DEBUG dbcounter [-] [75444] Writer thread running {{(pid=75444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 14:20:13 devstack cinder-volume[75444]: INFO cinder.rpc [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 14:20:13 devstack cinder-volume[75444]: INFO cinder.rpc [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 14:20:13 devstack cinder-volume[75444]: DEBUG oslo_db.sqlalchemy.engines [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75444) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 14:20:13 devstack cinder-volume[75444]: INFO cinder.volume.manager [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Determined volume DB was empty at startup. Nov 06 14:20:13 devstack cinder-volume[75444]: DEBUG cinder.volume.manager [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75444) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 06 14:20:13 devstack cinder-volume[75444]: INFO cinder.volume.manager [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 06 14:20:13 devstack cinder-volume[75444]: WARNING stevedore.named [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 14:20:13 devstack cinder-volume[75444]: WARNING castellan.key_manager [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 14:20:13 devstack cinder-volume[75444]: WARNING cinder.keymgr.conf_key_mgr [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 14:20:13 devstack cinder-volume[75444]: DEBUG cinder.volume.drivers.lvm [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75444) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 06 14:20:13 devstack cinder-volume[75444]: DEBUG oslo_concurrency.processutils [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:13 devstack cinder-volume[75444]: DEBUG oslo_concurrency.processutils [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] CMD "cinder-rtstool verify" returned: 0 in 0.423s {{(pid=75444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:13 devstack cinder-volume[75444]: DEBUG oslo_db.sqlalchemy.engines [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75444) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 14:20:13 devstack cinder-volume[75444]: INFO cinder.rpc [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 06 14:20:13 devstack cinder-volume[75444]: INFO cinder.rpc [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 06 14:20:13 devstack cinder-volume[75444]: WARNING stevedore.named [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 14:20:13 devstack cinder-volume[75444]: WARNING castellan.key_manager [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 14:20:13 devstack cinder-volume[75444]: INFO cinder.volume.manager [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_db.sqlalchemy.engines [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75444) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 14:20:14 devstack cinder-volume[75444]: INFO oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Starting 1 workers Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Started child 75599 {{(pid=75444) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Full set of CONF: {{(pid=75444) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] ******************************************************************************** {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Configuration options gathered from: {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] ================================================================================ {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] allow_availability_zone_fallback = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] allow_compression_on_image_upload = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] allowed_direct_url_schemes = [] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] api_rate_limit = True {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75599]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] auth_strategy = keystone {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] az_cache_duration = 3600 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_availability_zone = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_host = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_name = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_stats_polling_interval = 60 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backup_api_class = cinder.backup.api.API {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backup_name_template = backup-%s {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backup_use_same_host = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backup_use_temp_snapshot = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] chap_password = **** {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] chap_username = {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cinder_internal_tenant_project_id = 3e72fe74b45f42edafd367741eb68be4 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cinder_internal_tenant_user_id = 384ab531e7f14f81ab48252d790f27ba {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cloned_volume_same_az = True {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cluster = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] compression_format = gzip {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] compute_api_class = cinder.compute.nova.API {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] config_dir = [] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] config_source = [] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] control_exchange = openstack {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] debug = True {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] default_availability_zone = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] default_group_type = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] default_volume_type = lvmdriver-1 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] disk_geometry = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] driver_client_cert = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] driver_client_cert_key = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] driver_data_namespace = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] driver_ssl_cert_path = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] driver_ssl_cert_verify = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] driver_use_ssl = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] enable_force_upload = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] enable_new_services = True {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] enable_unsupported_driver = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] enforce_multipath_for_image_xfer = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] filter_function = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] glance_api_insecure = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] glance_api_servers = ['http://192.168.122.90/image'] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] glance_api_ssl_compression = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] glance_ca_certificates_file = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] glance_catalog_info = image:glance:publicURL {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] glance_certfile = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] glance_keyfile = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] glance_num_retries = 3 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] glance_request_timeout = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] goodness_function = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] graceful_shutdown_timeout = 5 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] group_api_class = cinder.group.api.API {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] host = devstack {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] image_compress_on_upload = True {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] image_conversion_address_space_limit = 1 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] image_conversion_cpu_limit = 60 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] image_conversion_disable = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] image_introspection_address_space_limit = 1 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] image_introspection_cpu_limit = 60 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] image_upload_use_cinder_backend = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] image_upload_use_internal_tenant = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] image_volume_cache_enabled = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] image_volume_cache_max_count = 0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] image_volume_cache_max_size_gb = 0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] init_host_max_objects_retrieval = 0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] instance_format = [instance: %(uuid)s] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] iscsi_target_flags = {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] iscsi_write_cache = on {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] iser_helper = tgtadm {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] iser_ip_address = 192.168.122.90 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] iser_port = 3260 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] log_color = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] log_config_append = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] log_dir = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] log_file = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] log_options = True {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] log_rotate_interval = 1 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] log_rotate_interval_type = days {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] log_rotation_type = none {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] max_age = 0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] max_logfile_count = 30 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] max_logfile_size_mb = 200 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] max_over_subscription_ratio = 20.0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] message_reap_interval = 86400 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] message_ttl = 2592000 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] migration_create_volume_timeout_secs = 300 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] monkey_patch = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] monkey_patch_modules = [] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] my_ip = 192.168.122.90 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] no_snapshot_gb_quota = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] num_iser_scan_tries = 3 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] num_shell_tries = 3 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] num_volume_device_scan_tries = 3 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] nvmeof_conn_info_version = 1 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] nvmet_ns_id = 10 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] nvmet_port_id = 1 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] osapi_max_limit = 1000 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] osapi_volume_ext_list = [] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] osapi_volume_listen_port = 8776 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] osapi_volume_use_ssl = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] osapi_volume_workers = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] per_volume_size_limit = -1 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] periodic_fuzzy_delay = 60 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] periodic_interval = 60 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] public_endpoint = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] publish_errors = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] quota_backup_gigabytes = 1000 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] quota_backups = 10 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] quota_gigabytes = 1000 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] quota_groups = 10 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] quota_snapshots = 10 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] quota_volumes = 10 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] rate_limit_burst = 0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] rate_limit_except_level = CRITICAL {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] rate_limit_interval = 0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] reinit_driver_count = 3 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] replication_device = **** {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] report_discard_supported = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] report_interval = 120 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] reservation_clean_interval = 86400 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] reservation_expire = 86400 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] reserved_image_namespaces = [] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] reserved_percentage = 0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] rpc_response_timeout = 120 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] run_external_periodic_tasks = True {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] scst_target_driver = iscsi {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] scst_target_iqn_name = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] service_down_time = 720 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] shell_completion = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] snapshot_name_template = snapshot-%s {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] snapshot_same_host = True {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] split_loggers = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] state_path = /opt/stack/data/cinder {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] storage_availability_zone = nova {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] storage_protocol = iSCSI {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75599]: INFO cinder.volume.manager [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] syslog_log_facility = LOG_USER {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] target_helper = lioadm {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] target_ip_address = 192.168.122.90 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] target_port = 3260 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] target_protocol = iscsi {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] target_secondary_ip_addresses = [] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] trace_flags = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] transport_url = **** {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] until_refresh = 0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] use_chap_auth = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] use_default_quota_class = True {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] use_journal = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] use_json = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] use_multipath_for_image_xfer = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] use_stderr = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] use_syslog = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] verify_glance_signatures = enabled {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] volume_api_class = cinder.volume.api.API {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] volume_backend_name = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] volume_clear = zero {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] volume_clear_ionice = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] volume_clear_size = 0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] volume_copy_bps_limit = 0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] volume_dd_blocksize = 1M {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] volume_name_template = volume-%s {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] volume_service_inithost_offload = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] volume_usage_audit_period = month {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] zoning_mode = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_concurrency.disable_process_locking = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.auth_section = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.auth_type = password {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.auth_version = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.cache = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.certfile = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.include_service_catalog = True {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.insecure = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.interface = public {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.keyfile = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.memcache_password = **** {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.memcache_username = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.region_name = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.service_type = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.90/identity {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.backend = dogpile.cache.null {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.backend_argument = **** {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.backend_expiration_time = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.config_prefix = cache.oslo {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.debug_cache_backend = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.enable_retry_client = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.enable_socket_keepalive = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.enabled = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.expiration_time = 600 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.hashclient_retry_attempts = 2 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.memcache_dead_retry = 300 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.memcache_pool_maxsize = 10 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.memcache_sasl_enabled = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.password = **** {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.proxies = [] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.redis_db = 0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.redis_server = localhost:6379 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.retry_attempts = 2 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.retry_delay = 0.0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.socket_keepalive_count = 1 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.socket_keepalive_idle = 1 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.socket_keepalive_interval = 1 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.socket_timeout = 1.0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.tls_allowed_ciphers = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.tls_cafile = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.tls_certfile = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.tls_enabled = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.tls_keyfile = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cache.username = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] coordination.backend_url = **** {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] database.asyncio_connection = **** {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] database.asyncio_slave_connection = **** {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] database.backend = sqlalchemy {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] database.connection = **** {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] database.connection_debug = 0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] database.connection_parameters = {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] database.connection_recycle_time = 3600 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] database.connection_trace = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] database.db_inc_retry_interval = True {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] database.db_max_retries = 20 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] database.db_max_retry_interval = 10 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] database.db_retry_interval = 1 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] database.max_overflow = 50 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] database.max_pool_size = 5 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] database.max_retries = 10 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] database.mysql_wsrep_sync_wait = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] database.pool_timeout = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] database.retry_interval = 10 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] database.slave_connection = **** {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] database.sqlite_synchronous = True {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] database.synchronous_reader = True {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] database.use_db_reconnect = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_tracing.insecure = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] profiler.connection_string = messaging:// {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] profiler.enabled = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] profiler.es_doc_type = notification {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] profiler.es_scroll_size = 10000 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] profiler.es_scroll_time = 2m {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] profiler.filter_error_trace = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] profiler.hmac_keys = **** {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] profiler.sentinel_service_name = mymaster {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] profiler.socket_timeout = 0.1 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] profiler.trace_requests = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] profiler.trace_sqlalchemy = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] profiler_jaeger.process_tags = {} {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] profiler_jaeger.service_name_prefix = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] profiler_otlp.service_name_prefix = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_policy.enforce_new_defaults = True {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_policy.policy_default_rule = default {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_policy.policy_file = policy.yaml {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] privsep_osbrick.group = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] privsep_osbrick.helper_command = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] privsep_osbrick.user = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cinder_sys_admin.group = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cinder_sys_admin.helper_command = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] cinder_sys_admin.user = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] service_user.auth_section = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] service_user.auth_type = password {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] service_user.cafile = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] service_user.certfile = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] service_user.collect_timing = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] service_user.insecure = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] service_user.keyfile = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] service_user.send_service_user_token = True {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] service_user.split_loggers = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] service_user.timeout = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] service_user.tls_ciphers = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] service_user.tls_min_version = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] glance.auth_section = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] glance.auth_type = password {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] glance.certfile = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] glance.collect_timing = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] glance.insecure = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] glance.keyfile = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] glance.region_name = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] glance.split_loggers = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] glance.timeout = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] glance.tls_ciphers = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] glance.tls_min_version = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.backend_availability_zone = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.chap_password = **** {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.chap_username = {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.disk_geometry = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.driver_client_cert = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.driver_client_cert_key = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.driver_data_namespace = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.driver_use_ssl = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.extra_capabilities = {} {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.filter_function = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.goodness_function = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.iscsi_target_flags = {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.iscsi_write_cache = on {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.iser_helper = tgtadm {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.iser_ip_address = 192.168.122.90 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.iser_port = 3260 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.lvm_share_target = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.lvm_type = auto {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.num_shell_tries = 3 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.replication_device = **** {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.report_discard_supported = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.reserved_percentage = 0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.target_helper = tgtadm {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.target_ip_address = 192.168.122.90 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.target_port = 3260 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.target_protocol = iscsi {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.trace_flags = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.unique_fqdn_network = True {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.use_chap_auth = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.volume_backend_name = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.volume_clear = zero {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.volume_clear_ionice = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.volume_clear_size = 0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_reports.file_event_handler = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_reports.log_dir = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.backend_host = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.chap_password = **** {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.chap_username = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.disk_geometry = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.driver_client_cert = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.extra_capabilities = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.filter_function = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.goodness_function = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.iser_helper = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.iser_ip_address = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.iser_port = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.lvm_share_target = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.lvm_type = auto {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.num_shell_tries = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.replication_device = **** {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.report_discard_supported = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.reserved_percentage = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.scst_target_driver = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.storage_protocol = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.target_helper = lioadm {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.target_ip_address = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.target_port = 3260 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.trace_flags = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.use_chap_auth = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.volume_clear = zero {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.volume_clear_size = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] lvmdriver-1.volumes_dir = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.ssl = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.068s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_notifications.driver = [] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_notifications.retry = -1 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] key_manager.fixed_key = **** {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican.barbican_api_version = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican.barbican_endpoint = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican.barbican_endpoint_type = public {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican.barbican_region_name = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican.cafile = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican.certfile = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican.collect_timing = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican.insecure = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican.keyfile = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican.number_of_retries = 60 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican.retry_delay = 1 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican.send_service_user_token = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican.split_loggers = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican.timeout = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican.tls_ciphers = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican.tls_min_version = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican.verify_ssl = True {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican.verify_ssl_path = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican_service_user.auth_section = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican_service_user.auth_type = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican_service_user.cafile = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican_service_user.certfile = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican_service_user.collect_timing = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican_service_user.insecure = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican_service_user.keyfile = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican_service_user.split_loggers = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican_service_user.timeout = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican_service_user.tls_ciphers = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] barbican_service_user.tls_min_version = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] vault.approle_role_id = **** {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] vault.approle_secret_id = **** {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] vault.auth_method = approle {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] vault.auth_path = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] vault.kv_mountpoint = secret {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] vault.kv_path = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] vault.kv_version = 2 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] vault.namespace = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] vault.root_token_id = **** {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] vault.ssl_ca_crt_file = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] vault.timeout = 60.0 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] vault.token_file = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] vault.token_role = None {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] vault.use_ssl = False {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:20:14 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] ******************************************************************************** {{(pid=75444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 14:20:14 devstack sudo[75606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 06 14:20:14 devstack sudo[75606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:20:14 devstack sudo[75606]: pam_unix(sudo:session): session closed for user root Nov 06 14:20:14 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:14 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:14 devstack sudo[75610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 14:20:14 devstack sudo[75610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:20:14 devstack sudo[75610]: pam_unix(sudo:session): session closed for user root Nov 06 14:20:14 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.287s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:14 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 14:20:14 devstack cinder-volume[75599]: INFO cinder.brick.local_dev.lvm [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 06 14:20:14 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:14 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:14 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:14 devstack sudo[75725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 14:20:14 devstack sudo[75725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:20:15 devstack sudo[75725]: pam_unix(sudo:session): session closed for user root Nov 06 14:20:15 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:15 devstack cinder-volume[75599]: DEBUG cinder.brick.local_dev.lvm [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75599) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 06 14:20:15 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:15 devstack sudo[75833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 14:20:15 devstack sudo[75833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:20:15 devstack sudo[75833]: pam_unix(sudo:session): session closed for user root Nov 06 14:20:15 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.513s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:15 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:15 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:15 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:15 devstack sudo[76028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 14:20:15 devstack sudo[76028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:20:16 devstack sudo[76028]: pam_unix(sudo:session): session closed for user root Nov 06 14:20:16 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:16 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:16 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:16 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:16 devstack sudo[76127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 06 14:20:16 devstack sudo[76127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:20:16 devstack sudo[76127]: pam_unix(sudo:session): session closed for user root Nov 06 14:20:16 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.327s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:16 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:16 devstack sudo[76218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 14:20:16 devstack sudo[76218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:20:16 devstack sudo[76218]: pam_unix(sudo:session): session closed for user root Nov 06 14:20:16 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:16 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:16 devstack sudo[76221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 14:20:16 devstack sudo[76221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:20:16 devstack sudo[76221]: pam_unix(sudo:session): session closed for user root Nov 06 14:20:16 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.316s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:16 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:16 devstack sudo[76306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 14:20:16 devstack sudo[76306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:20:17 devstack sudo[76306]: pam_unix(sudo:session): session closed for user root Nov 06 14:20:17 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:17 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:17 devstack sudo[76309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 14:20:17 devstack sudo[76309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:20:17 devstack sudo[76309]: pam_unix(sudo:session): session closed for user root Nov 06 14:20:17 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.316s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:17 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:17 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:17 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:17 devstack sudo[76377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 14:20:17 devstack sudo[76377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:20:17 devstack sudo[76377]: pam_unix(sudo:session): session closed for user root Nov 06 14:20:17 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.290s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:17 devstack cinder-volume[75599]: INFO cinder.volume.drivers.lvm [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 06 14:20:17 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:17 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:17 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:17 devstack sudo[76409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 14:20:17 devstack sudo[76409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:20:18 devstack sudo[76409]: pam_unix(sudo:session): session closed for user root Nov 06 14:20:18 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:18 devstack cinder-volume[75599]: DEBUG cinder.volume.drivers.lvm [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Updating volume stats {{(pid=75599) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 14:20:18 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:18 devstack sudo[76412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 14:20:18 devstack sudo[76412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:20:18 devstack sudo[76412]: pam_unix(sudo:session): session closed for user root Nov 06 14:20:18 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:18 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:18 devstack sudo[76415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 14:20:18 devstack sudo[76415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:20:18 devstack sudo[76415]: pam_unix(sudo:session): session closed for user root Nov 06 14:20:18 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:18 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:18 devstack sudo[76419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 14:20:18 devstack sudo[76419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:20:18 devstack sudo[76419]: pam_unix(sudo:session): session closed for user root Nov 06 14:20:18 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:18 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:18 devstack sudo[76422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 14:20:18 devstack sudo[76422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:20:19 devstack sudo[76422]: pam_unix(sudo:session): session closed for user root Nov 06 14:20:19 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:19 devstack cinder-volume[75599]: INFO cinder.volume.driver [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Driver hasn't implemented _init_vendor_properties() Nov 06 14:20:19 devstack cinder-volume[75599]: DEBUG cinder.volume.driver [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75599) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 14:20:19 devstack cinder-volume[75599]: DEBUG oslo_db.sqlalchemy.engines [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75599) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 14:20:19 devstack cinder-volume[75599]: DEBUG dbcounter [-] [75599] Writer thread running {{(pid=75599) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 14:20:19 devstack cinder-volume[75599]: DEBUG cinder.db.api [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Building query based on filter {{(pid=75599) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 06 14:20:19 devstack cinder-volume[75599]: DEBUG cinder.image.image_utils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75599) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 06 14:20:19 devstack cinder-volume[75599]: INFO cinder.keymgr.migration [None req-8c693fad-bdee-4994-aafd-cb5454c75085 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 14:20:19 devstack cinder-volume[75599]: DEBUG cinder.volume.drivers.lvm [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Updating volume stats {{(pid=75599) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 14:20:19 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:19 devstack sudo[76425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 14:20:19 devstack sudo[76425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:20:19 devstack sudo[76425]: pam_unix(sudo:session): session closed for user root Nov 06 14:20:19 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:19 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:19 devstack sudo[76428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 14:20:19 devstack sudo[76428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:20:19 devstack sudo[76428]: pam_unix(sudo:session): session closed for user root Nov 06 14:20:19 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:19 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:19 devstack sudo[76433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 14:20:19 devstack sudo[76433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:20:20 devstack sudo[76433]: pam_unix(sudo:session): session closed for user root Nov 06 14:20:20 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:20 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:20 devstack sudo[76437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 14:20:20 devstack sudo[76437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:20:20 devstack sudo[76437]: pam_unix(sudo:session): session closed for user root Nov 06 14:20:20 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:20 devstack cinder-volume[75599]: DEBUG cinder.manager [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Notifying Schedulers of capabilities ... {{(pid=75599) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:20:20 devstack cinder-volume[75599]: INFO cinder.volume.manager [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Driver initialization completed successfully. Nov 06 14:20:20 devstack cinder-volume[75599]: INFO cinder.manager [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Initiating service 2 cleanup Nov 06 14:20:20 devstack cinder-volume[75599]: INFO cinder.manager [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Service 2 cleanup completed. Nov 06 14:20:20 devstack cinder-volume[75599]: DEBUG cinder.service [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Creating RPC server for service cinder-volume {{(pid=75599) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 14:20:20 devstack cinder-volume[75599]: DEBUG cinder.service [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75599) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 14:20:20 devstack cinder-volume[75599]: INFO cinder.volume.manager [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 06 14:20:20 devstack cinder-volume[75599]: DEBUG cinder.volume.drivers.lvm [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Updating volume stats {{(pid=75599) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 14:20:20 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:20 devstack sudo[76440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 14:20:20 devstack sudo[76440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:20:20 devstack sudo[76440]: pam_unix(sudo:session): session closed for user root Nov 06 14:20:20 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:20 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:20 devstack sudo[76447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 14:20:20 devstack sudo[76447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:20:21 devstack sudo[76447]: pam_unix(sudo:session): session closed for user root Nov 06 14:20:21 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:21 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:21 devstack sudo[76451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 14:20:21 devstack sudo[76451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:20:21 devstack sudo[76451]: pam_unix(sudo:session): session closed for user root Nov 06 14:20:21 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:21 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:20:21 devstack sudo[76454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 14:20:21 devstack sudo[76454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:20:21 devstack sudo[76454]: pam_unix(sudo:session): session closed for user root Nov 06 14:20:21 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:20:21 devstack cinder-volume[75599]: INFO cinder.volume.manager [None req-caccfb0a-ae1f-44d5-9652-1a08f132c0b1 None None] Driver post RPC initialization completed successfully. Nov 06 14:20:24 devstack cinder-volume[75444]: DEBUG dbcounter [-] [75444] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:20:31 devstack cinder-volume[75599]: DEBUG dbcounter [-] [75599] Writing DB stats cinder:SELECT=3 {{(pid=75599) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:20:31 devstack cinder-volume[75599]: DEBUG dbcounter [-] [75599] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75599) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:20:38 devstack cinder-volume[75599]: DEBUG oslo_service.periodic_task [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Running periodic task VolumeManager._thread_info {{(pid=75599) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:20:38 devstack cinder-volume[75599]: DEBUG cinder.volume.manager [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] thread count: 6 {{(pid=75599) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 14:20:38 devstack cinder-volume[75599]: DEBUG cinder.volume.manager [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] thread info: [<_MainThread(MainThread, started 123788985991296)>, , , , , ] {{(pid=75599) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 14:21:38 devstack cinder-volume[75599]: DEBUG oslo_service.periodic_task [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75599) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:21:38 devstack cinder-volume[75599]: DEBUG cinder.volume.drivers.lvm [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Updating volume stats {{(pid=75599) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 14:21:38 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:21:38 devstack sudo[78967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 14:21:38 devstack sudo[78967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:21:39 devstack sudo[78967]: pam_unix(sudo:session): session closed for user root Nov 06 14:21:39 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:21:39 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:21:39 devstack sudo[78970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 14:21:39 devstack sudo[78970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:21:39 devstack sudo[78970]: pam_unix(sudo:session): session closed for user root Nov 06 14:21:39 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:21:39 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:21:39 devstack sudo[78981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 14:21:39 devstack sudo[78981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:21:39 devstack sudo[78981]: pam_unix(sudo:session): session closed for user root Nov 06 14:21:39 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:21:39 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:21:39 devstack sudo[78984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 14:21:39 devstack sudo[78984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:21:39 devstack sudo[78984]: pam_unix(sudo:session): session closed for user root Nov 06 14:21:39 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:21:39 devstack cinder-volume[75599]: DEBUG cinder.manager [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Notifying Schedulers of capabilities ... {{(pid=75599) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:21:39 devstack cinder-volume[75599]: DEBUG oslo_service.periodic_task [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Running periodic task VolumeManager._thread_info {{(pid=75599) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:21:39 devstack cinder-volume[75599]: DEBUG cinder.volume.manager [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] thread count: 6 {{(pid=75599) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 14:21:39 devstack cinder-volume[75599]: DEBUG cinder.volume.manager [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] thread info: [<_MainThread(MainThread, started 123788985991296)>, , , , , ] {{(pid=75599) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 14:22:31 devstack cinder-volume[75599]: DEBUG dbcounter [-] [75599] Writing DB stats cinder:SELECT=1 {{(pid=75599) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:22:31 devstack cinder-volume[75599]: DEBUG dbcounter [-] [75599] Writing DB stats cinder:UPDATE=1 {{(pid=75599) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:22:38 devstack cinder-volume[75599]: DEBUG oslo_service.periodic_task [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75599) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:22:38 devstack cinder-volume[75599]: DEBUG cinder.volume.drivers.lvm [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Updating volume stats {{(pid=75599) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 14:22:38 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:22:38 devstack sudo[82000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 14:22:38 devstack sudo[82000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:22:39 devstack sudo[82000]: pam_unix(sudo:session): session closed for user root Nov 06 14:22:39 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:22:39 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:22:39 devstack sudo[82003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 14:22:39 devstack sudo[82003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:22:39 devstack sudo[82003]: pam_unix(sudo:session): session closed for user root Nov 06 14:22:39 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:22:39 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:22:39 devstack sudo[82006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 14:22:39 devstack sudo[82006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:22:39 devstack sudo[82006]: pam_unix(sudo:session): session closed for user root Nov 06 14:22:39 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:22:39 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:22:39 devstack sudo[82009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 14:22:39 devstack sudo[82009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:22:39 devstack sudo[82009]: pam_unix(sudo:session): session closed for user root Nov 06 14:22:39 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:22:39 devstack cinder-volume[75599]: DEBUG cinder.manager [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Notifying Schedulers of capabilities ... {{(pid=75599) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:22:39 devstack cinder-volume[75599]: DEBUG oslo_service.periodic_task [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Running periodic task VolumeManager._thread_info {{(pid=75599) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:22:39 devstack cinder-volume[75599]: DEBUG cinder.volume.manager [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] thread count: 6 {{(pid=75599) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 14:22:39 devstack cinder-volume[75599]: DEBUG cinder.volume.manager [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] thread info: [<_MainThread(MainThread, started 123788985991296)>, , , , , ] {{(pid=75599) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 14:23:38 devstack cinder-volume[75599]: DEBUG oslo_service.periodic_task [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75599) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:23:38 devstack cinder-volume[75599]: DEBUG cinder.volume.drivers.lvm [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Updating volume stats {{(pid=75599) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 14:23:38 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:23:38 devstack sudo[84321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 14:23:38 devstack sudo[84321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:23:39 devstack sudo[84321]: pam_unix(sudo:session): session closed for user root Nov 06 14:23:39 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:23:39 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:23:39 devstack sudo[84331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 14:23:39 devstack sudo[84331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:23:39 devstack sudo[84331]: pam_unix(sudo:session): session closed for user root Nov 06 14:23:39 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:23:39 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:23:39 devstack sudo[84347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 14:23:39 devstack sudo[84347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:23:39 devstack sudo[84347]: pam_unix(sudo:session): session closed for user root Nov 06 14:23:39 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:23:39 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:23:39 devstack sudo[84355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 14:23:39 devstack sudo[84355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:23:39 devstack sudo[84355]: pam_unix(sudo:session): session closed for user root Nov 06 14:23:39 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:23:39 devstack cinder-volume[75599]: DEBUG cinder.manager [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Notifying Schedulers of capabilities ... {{(pid=75599) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:23:39 devstack cinder-volume[75599]: DEBUG oslo_service.periodic_task [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Running periodic task VolumeManager._thread_info {{(pid=75599) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:23:39 devstack cinder-volume[75599]: DEBUG cinder.volume.manager [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] thread count: 6 {{(pid=75599) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 14:23:39 devstack cinder-volume[75599]: DEBUG cinder.volume.manager [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] thread info: [<_MainThread(MainThread, started 123788985991296)>, , , , , ] {{(pid=75599) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 14:24:31 devstack cinder-volume[75599]: DEBUG dbcounter [-] [75599] Writing DB stats cinder:SELECT=1 {{(pid=75599) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:24:31 devstack cinder-volume[75599]: DEBUG dbcounter [-] [75599] Writing DB stats cinder:UPDATE=1 {{(pid=75599) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:24:38 devstack cinder-volume[75599]: DEBUG oslo_service.periodic_task [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75599) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:24:38 devstack cinder-volume[75599]: DEBUG cinder.volume.drivers.lvm [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Updating volume stats {{(pid=75599) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 14:24:38 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:24:38 devstack sudo[85425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 14:24:38 devstack sudo[85425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:24:39 devstack sudo[85425]: pam_unix(sudo:session): session closed for user root Nov 06 14:24:39 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:24:39 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:24:39 devstack sudo[85439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 14:24:39 devstack sudo[85439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:24:39 devstack sudo[85439]: pam_unix(sudo:session): session closed for user root Nov 06 14:24:39 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:24:39 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:24:39 devstack sudo[85456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 14:24:39 devstack sudo[85456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:24:39 devstack sudo[85456]: pam_unix(sudo:session): session closed for user root Nov 06 14:24:39 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.239s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:24:39 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:24:39 devstack sudo[85468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 14:24:39 devstack sudo[85468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:24:39 devstack sudo[85468]: pam_unix(sudo:session): session closed for user root Nov 06 14:24:39 devstack cinder-volume[75599]: DEBUG oslo_concurrency.processutils [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=75599) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:24:39 devstack cinder-volume[75599]: DEBUG cinder.manager [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Notifying Schedulers of capabilities ... {{(pid=75599) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:24:39 devstack cinder-volume[75599]: DEBUG oslo_service.periodic_task [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] Running periodic task VolumeManager._thread_info {{(pid=75599) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:24:39 devstack cinder-volume[75599]: DEBUG cinder.volume.manager [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] thread count: 6 {{(pid=75599) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 14:24:39 devstack cinder-volume[75599]: DEBUG cinder.volume.manager [None req-375b9cff-bf1a-4d48-851a-8544ecda7e6b None None] thread info: [<_MainThread(MainThread, started 123788985991296)>, , , , , ] {{(pid=75599) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 14:24:42 devstack cinder-volume[75444]: INFO oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Caught SIGTERM, stopping children Nov 06 14:24:42 devstack cinder-volume[75444]: DEBUG oslo_concurrency.lockutils [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Acquiring lock "singleton_lock" {{(pid=75444) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 14:24:42 devstack cinder-volume[75444]: DEBUG oslo_concurrency.lockutils [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Acquired lock "singleton_lock" {{(pid=75444) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 14:24:42 devstack cinder-volume[75444]: DEBUG oslo_concurrency.lockutils [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Releasing lock "singleton_lock" {{(pid=75444) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 14:24:42 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Stop services. {{(pid=75444) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 06 14:24:42 devstack cinder-volume[75444]: DEBUG oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Killing children. {{(pid=75444) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 06 14:24:42 devstack cinder-volume[75444]: INFO oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Waiting on 1 children to exit Nov 06 14:24:45 devstack cinder-volume[75599]: DEBUG oslo_concurrency.lockutils [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Acquiring lock "singleton_lock" {{(pid=75599) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 14:24:45 devstack cinder-volume[75599]: DEBUG oslo_concurrency.lockutils [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Acquired lock "singleton_lock" {{(pid=75599) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 14:24:45 devstack cinder-volume[75599]: DEBUG oslo_concurrency.lockutils [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Releasing lock "singleton_lock" {{(pid=75599) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 14:24:45 devstack cinder-volume[75599]: WARNING amqp [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 14:24:45 devstack cinder-volume[75599]: WARNING amqp [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 14:24:45 devstack cinder-volume[75444]: INFO oslo_service.backend._eventlet.service [None req-c83373fe-4340-482d-91d0-0cbc7e48e8e9 None None] Child 75599 exited with status 0 Nov 06 14:24:46 devstack cinder-volume[85648]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 14:24:46 devstack cinder-volume[85648]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 14:24:46 devstack cinder-volume[85648]: we strongly recommend against using it for new projects. Nov 06 14:24:46 devstack cinder-volume[85648]: If you are already using Eventlet, we recommend migrating to a different Nov 06 14:24:46 devstack cinder-volume[85648]: framework. For more detail see Nov 06 14:24:46 devstack cinder-volume[85648]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 14:24:46 devstack cinder-volume[85648]: import eventlet # noqa Nov 06 14:24:48 devstack cinder-volume[85648]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85648) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 14:24:48 devstack cinder-volume[85648]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85648) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 14:24:48 devstack cinder-volume[85648]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85648) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 14:24:48 devstack cinder-volume[85648]: INFO dbcounter [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] Registered counter for database cinder Nov 06 14:24:48 devstack cinder-volume[85648]: DEBUG oslo_db.sqlalchemy.engines [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85648) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG dbcounter [-] [85648] Writer thread running {{(pid=85648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 14:24:49 devstack cinder-volume[85648]: INFO cinder.rpc [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 14:24:49 devstack cinder-volume[85648]: INFO cinder.rpc [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_db.sqlalchemy.engines [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85648) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 14:24:49 devstack cinder-volume[85648]: INFO cinder.volume.manager [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] Determined volume DB was empty at startup. Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG cinder.volume.manager [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85648) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 06 14:24:49 devstack cinder-volume[85648]: INFO cinder.volume.manager [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 06 14:24:49 devstack cinder-volume[85648]: WARNING stevedore.named [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 14:24:49 devstack cinder-volume[85648]: WARNING castellan.key_manager [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 14:24:49 devstack cinder-volume[85648]: WARNING cinder.keymgr.conf_key_mgr [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 14:24:49 devstack cinder-volume[85648]: INFO cinder.volume.manager [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_db.sqlalchemy.engines [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85648) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 14:24:49 devstack cinder-volume[85648]: INFO oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] Starting 1 workers Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] Started child 85867 {{(pid=85648) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] Full set of CONF: {{(pid=85648) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] ******************************************************************************** {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] Configuration options gathered from: {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] ================================================================================ {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] allow_availability_zone_fallback = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] allow_compression_on_image_upload = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] allowed_direct_url_schemes = [] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] api_rate_limit = True {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] auth_strategy = keystone {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_availability_zone = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_host = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_name = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_stats_polling_interval = 60 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backup_api_class = cinder.backup.api.API {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backup_name_template = backup-%s {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backup_use_same_host = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backup_use_temp_snapshot = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] chap_password = **** {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] chap_username = {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cinder_internal_tenant_project_id = 3e72fe74b45f42edafd367741eb68be4 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cinder_internal_tenant_user_id = 384ab531e7f14f81ab48252d790f27ba {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cluster = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85867]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] compression_format = gzip {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] compute_api_class = cinder.compute.nova.API {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] config_dir = [] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] config_source = [] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] control_exchange = openstack {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] debug = True {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] default_availability_zone = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] default_group_type = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] default_volume_type = QuobyteHD {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] disk_geometry = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] driver_client_cert = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] driver_client_cert_key = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] driver_data_namespace = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] driver_ssl_cert_path = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] driver_ssl_cert_verify = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] driver_use_ssl = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] enable_new_services = True {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] enable_unsupported_driver = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] enabled_backends = ['QuobyteHD'] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] enforce_multipath_for_image_xfer = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] filter_function = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] glance_api_insecure = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] glance_api_servers = ['http://192.168.122.90/image'] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] glance_api_ssl_compression = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] glance_ca_certificates_file = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] glance_catalog_info = image:glance:publicURL {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] glance_certfile = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] glance_keyfile = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] glance_num_retries = 3 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] glance_request_timeout = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] goodness_function = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] graceful_shutdown_timeout = 5 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] group_api_class = cinder.group.api.API {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] host = devstack {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] image_compress_on_upload = True {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] image_conversion_address_space_limit = 1 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] image_conversion_cpu_limit = 60 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] image_conversion_disable = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] image_introspection_address_space_limit = 1 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] image_introspection_cpu_limit = 60 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] image_upload_use_cinder_backend = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] image_upload_use_internal_tenant = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] image_volume_cache_enabled = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] image_volume_cache_max_count = 0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] image_volume_cache_max_size_gb = 0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] init_host_max_objects_retrieval = 0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] instance_format = [instance: %(uuid)s] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] iscsi_target_flags = {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] iscsi_write_cache = on {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] iser_helper = tgtadm {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] iser_ip_address = 192.168.122.90 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] iser_port = 3260 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] log_color = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] log_config_append = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] log_dir = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] log_file = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] log_options = True {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] log_rotate_interval = 1 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] log_rotate_interval_type = days {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] log_rotation_type = none {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] max_age = 0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] max_logfile_count = 30 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] max_logfile_size_mb = 200 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] max_over_subscription_ratio = 20.0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] message_reap_interval = 86400 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] message_ttl = 2592000 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] migration_create_volume_timeout_secs = 300 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] monkey_patch = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] monkey_patch_modules = [] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] my_ip = 192.168.122.90 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] no_snapshot_gb_quota = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] num_iser_scan_tries = 3 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] num_shell_tries = 3 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] num_volume_device_scan_tries = 3 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] nvmeof_conn_info_version = 1 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] nvmet_ns_id = 10 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] nvmet_port_id = 1 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] osapi_max_limit = 1000 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] osapi_volume_ext_list = [] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] osapi_volume_listen_port = 8776 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] osapi_volume_use_ssl = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] osapi_volume_workers = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] per_volume_size_limit = -1 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] periodic_fuzzy_delay = 60 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] periodic_interval = 60 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] public_endpoint = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] publish_errors = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] quota_backup_gigabytes = 1000 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] quota_backups = 10 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] quota_gigabytes = 1000 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] quota_groups = 10 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] quota_snapshots = 10 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] quota_volumes = 10 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] rate_limit_burst = 0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] rate_limit_except_level = CRITICAL {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] rate_limit_interval = 0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] reinit_driver_count = 3 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] replication_device = **** {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] report_discard_supported = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] report_interval = 120 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] reservation_clean_interval = 86400 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] reservation_expire = 86400 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] reserved_image_namespaces = [] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] reserved_percentage = 0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] rpc_response_timeout = 120 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] run_external_periodic_tasks = True {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] scst_target_driver = iscsi {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] scst_target_iqn_name = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] service_down_time = 720 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] shell_completion = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] snapshot_name_template = snapshot-%s {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] split_loggers = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] state_path = /opt/stack/data/cinder {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] storage_availability_zone = nova {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] storage_protocol = iSCSI {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] syslog_log_facility = LOG_USER {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] target_helper = lioadm {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] target_ip_address = 192.168.122.90 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] target_port = 3260 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] target_protocol = iscsi {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] target_secondary_ip_addresses = [] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] trace_flags = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] transport_url = **** {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] until_refresh = 0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] use_chap_auth = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] use_default_quota_class = True {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] use_journal = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] use_json = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] use_multipath_for_image_xfer = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] use_stderr = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] use_syslog = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] verify_glance_signatures = enabled {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] volume_api_class = cinder.volume.api.API {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] volume_backend_name = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] volume_clear = zero {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] volume_clear_ionice = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] volume_clear_size = 0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] volume_copy_bps_limit = 0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] volume_dd_blocksize = 1M {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] volume_name_template = volume-%s {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] volume_service_inithost_offload = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] volume_usage_audit_period = month {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] zoning_mode = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_concurrency.disable_process_locking = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.auth_section = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.auth_type = password {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.auth_version = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.cache = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.certfile = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.include_service_catalog = True {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.insecure = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.interface = public {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.keyfile = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.memcache_password = **** {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.memcache_username = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.region_name = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.service_type = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.90/identity {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.backend = dogpile.cache.null {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.backend_argument = **** {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.backend_expiration_time = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.config_prefix = cache.oslo {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85867]: INFO cinder.volume.manager [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Starting volume driver QuobyteDriver (1.2.1) Nov 06 14:24:49 devstack cinder-volume[85867]: DEBUG cinder.volume.drivers.remotefs [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85867) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.debug_cache_backend = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.enable_retry_client = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.enable_socket_keepalive = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.enabled = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.expiration_time = 600 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.hashclient_retry_attempts = 2 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.memcache_dead_retry = 300 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.memcache_pool_maxsize = 10 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.memcache_sasl_enabled = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.password = **** {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.proxies = [] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.redis_db = 0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.redis_server = localhost:6379 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.retry_attempts = 2 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.retry_delay = 0.0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.socket_keepalive_count = 1 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.socket_keepalive_idle = 1 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.socket_keepalive_interval = 1 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.socket_timeout = 1.0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.tls_allowed_ciphers = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.tls_cafile = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.tls_certfile = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.tls_enabled = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.tls_keyfile = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cache.username = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] coordination.backend_url = **** {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] database.asyncio_connection = **** {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] database.asyncio_slave_connection = **** {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] database.backend = sqlalchemy {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] database.connection = **** {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] database.connection_debug = 0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] database.connection_parameters = {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] database.connection_recycle_time = 3600 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] database.connection_trace = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] database.db_inc_retry_interval = True {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] database.db_max_retries = 20 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] database.db_max_retry_interval = 10 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] database.db_retry_interval = 1 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] database.max_overflow = 50 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] database.max_pool_size = 5 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] database.max_retries = 10 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] database.mysql_wsrep_sync_wait = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] database.pool_timeout = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] database.retry_interval = 10 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] database.slave_connection = **** {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] database.sqlite_synchronous = True {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] database.synchronous_reader = True {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] database.use_db_reconnect = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_tracing.insecure = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] profiler.connection_string = messaging:// {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] profiler.enabled = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] profiler.es_doc_type = notification {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] profiler.es_scroll_size = 10000 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] profiler.es_scroll_time = 2m {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] profiler.filter_error_trace = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] profiler.hmac_keys = **** {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] profiler.sentinel_service_name = mymaster {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] profiler.socket_timeout = 0.1 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] profiler.trace_requests = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] profiler.trace_sqlalchemy = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] profiler_jaeger.process_tags = {} {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] profiler_jaeger.service_name_prefix = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] profiler_otlp.service_name_prefix = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_policy.enforce_new_defaults = True {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_policy.policy_default_rule = default {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_policy.policy_file = policy.yaml {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] privsep_osbrick.group = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] privsep_osbrick.helper_command = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] privsep_osbrick.user = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cinder_sys_admin.group = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cinder_sys_admin.helper_command = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] cinder_sys_admin.user = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] service_user.auth_section = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] service_user.auth_type = password {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] service_user.cafile = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] service_user.certfile = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] service_user.collect_timing = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] service_user.insecure = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] service_user.keyfile = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] service_user.send_service_user_token = True {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] service_user.split_loggers = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] service_user.timeout = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] service_user.tls_ciphers = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] service_user.tls_min_version = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] glance.auth_section = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] glance.auth_type = password {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] glance.certfile = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] glance.collect_timing = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] glance.insecure = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] glance.keyfile = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] glance.region_name = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] glance.split_loggers = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] glance.timeout = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] glance.tls_ciphers = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] glance.tls_min_version = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.backend_availability_zone = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.chap_password = **** {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.chap_username = {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.disk_geometry = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.driver_client_cert = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.driver_client_cert_key = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.driver_data_namespace = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.driver_use_ssl = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.extra_capabilities = {} {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.filter_function = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.goodness_function = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.iscsi_target_flags = {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.iscsi_write_cache = on {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.iser_helper = tgtadm {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.iser_ip_address = 192.168.122.90 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.iser_port = 3260 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.nas_host = {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.nas_login = admin {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.nas_mount_options = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.nas_password = **** {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.nas_private_key = {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.nas_share_path = {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.num_shell_tries = 3 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.quobyte_volume_url = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.replication_device = **** {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.report_discard_supported = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.reserved_percentage = 0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.target_helper = tgtadm {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.target_ip_address = 192.168.122.90 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.target_port = 3260 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.target_protocol = iscsi {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.trace_flags = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.unique_fqdn_network = True {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.use_chap_auth = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.volume_backend_name = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.volume_clear = zero {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.volume_clear_ionice = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.volume_clear_size = 0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_reports.file_event_handler = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_reports.log_dir = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.backend_availability_zone = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.backend_host = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.chap_password = **** {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.chap_username = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.chiscsi_conf = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.disk_geometry = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.driver_client_cert = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.driver_data_namespace = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.driver_use_ssl = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.extra_capabilities = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.filter_function = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.goodness_function = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.iser_helper = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.iser_ip_address = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.iser_port = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.iser_target_prefix = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.nas_host = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.nas_login = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.nas_mount_options = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.nas_password = **** {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.nas_private_key = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.nas_share_path = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.nas_ssh_port = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.num_shell_tries = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.nvmet_port_id = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.replication_device = **** {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.report_discard_supported = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.reserved_percentage = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.scst_target_driver = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.storage_protocol = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.target_helper = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.target_ip_address = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.target_port = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.target_prefix = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.target_protocol = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.trace_flags = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.use_chap_auth = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.volume_clear = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.volume_clear_size = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] QuobyteHD.volumes_dir = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85867]: DEBUG cinder.volume.drivers.quobyte [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85867) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 06 14:24:49 devstack cinder-volume[85867]: WARNING cinder.volume.drivers.quobyte [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 06 14:24:49 devstack cinder-volume[85867]: WARNING cinder.volume.drivers.quobyte [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85867]: DEBUG oslo_concurrency.processutils [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Running cmd (subprocess): mount.quobyte {{(pid=85867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.ssl = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_notifications.driver = [] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_notifications.retry = -1 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] key_manager.fixed_key = **** {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican.barbican_api_version = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican.barbican_endpoint = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican.barbican_endpoint_type = public {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican.barbican_region_name = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican.cafile = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican.certfile = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican.collect_timing = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican.insecure = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican.keyfile = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican.number_of_retries = 60 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican.retry_delay = 1 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican.send_service_user_token = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican.split_loggers = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican.timeout = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican.tls_ciphers = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican.tls_min_version = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican.verify_ssl = True {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican.verify_ssl_path = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican_service_user.auth_section = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican_service_user.auth_type = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican_service_user.cafile = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican_service_user.certfile = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican_service_user.collect_timing = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican_service_user.insecure = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican_service_user.keyfile = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican_service_user.split_loggers = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican_service_user.timeout = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican_service_user.tls_ciphers = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] barbican_service_user.tls_min_version = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] vault.approle_role_id = **** {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] vault.approle_secret_id = **** {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] vault.auth_method = approle {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] vault.auth_path = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] vault.kv_mountpoint = secret {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] vault.kv_path = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] vault.kv_version = 2 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] vault.namespace = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] vault.root_token_id = **** {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] vault.ssl_ca_crt_file = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] vault.timeout = 60.0 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] vault.token_file = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] vault.token_role = None {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] vault.use_ssl = False {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:24:49 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] ******************************************************************************** {{(pid=85648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 14:24:49 devstack quobyte-client[85872]: Reading configuration file: /etc/quobyte/client.cfg Nov 06 14:24:49 devstack quobyte-client[85872]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 06 14:24:49 devstack cinder-volume[85867]: DEBUG oslo_concurrency.processutils [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] CMD "mount.quobyte" returned: 1 in 0.097s {{(pid=85867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:24:49 devstack cinder-volume[85867]: DEBUG oslo_concurrency.lockutils [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:24:49 devstack cinder-volume[85867]: DEBUG oslo_concurrency.lockutils [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:24:49 devstack cinder-volume[85867]: DEBUG cinder.volume.drivers.quobyte [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=85867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:24:49 devstack cinder-volume[85867]: INFO cinder.volume.drivers.quobyte [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e ... Nov 06 14:24:49 devstack cinder-volume[85867]: DEBUG oslo_concurrency.processutils [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 -c /etc/quobyte/client-cinder.cfg {{(pid=85867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:24:49 devstack sudo[85873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 -c /etc/quobyte/client-cinder.cfg Nov 06 14:24:49 devstack sudo[85873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:24:50 devstack sudo[85873]: pam_unix(sudo:session): session closed for user root Nov 06 14:24:50 devstack cinder-volume[85867]: DEBUG oslo_concurrency.processutils [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.406s {{(pid=85867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:24:50 devstack cinder-volume[85867]: INFO cinder.volume.drivers.quobyte [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e succeeded Nov 06 14:24:50 devstack cinder-volume[85867]: DEBUG cinder.volume.drivers.quobyte [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=85867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:24:50 devstack cinder-volume[85867]: DEBUG oslo_concurrency.lockutils [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.417s {{(pid=85867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:24:50 devstack cinder-volume[85867]: DEBUG oslo_concurrency.processutils [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=85867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:24:50 devstack sudo[85975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:24:50 devstack sudo[85975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:24:50 devstack sudo[85975]: pam_unix(sudo:session): session closed for user root Nov 06 14:24:50 devstack cinder-volume[85867]: DEBUG oslo_concurrency.processutils [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.238s {{(pid=85867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:24:50 devstack cinder-volume[85867]: INFO cinder.volume.driver [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Driver hasn't implemented _init_vendor_properties() Nov 06 14:24:50 devstack cinder-volume[85867]: DEBUG cinder.volume.driver [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3879013061523, 'free_capacity_gb': 1773.3879013061523, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85867) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 14:24:50 devstack cinder-volume[85867]: DEBUG oslo_db.sqlalchemy.engines [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85867) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 14:24:50 devstack cinder-volume[85867]: DEBUG dbcounter [-] [85867] Writer thread running {{(pid=85867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 14:24:50 devstack cinder-volume[85867]: DEBUG cinder.db.api [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Building query based on filter {{(pid=85867) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 06 14:24:50 devstack cinder-volume[85867]: DEBUG cinder.image.image_utils [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85867) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 06 14:24:50 devstack cinder-volume[85867]: INFO cinder.keymgr.migration [None req-346f4765-28cc-4385-b465-9a3d5763bf4d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 14:24:50 devstack cinder-volume[85867]: DEBUG oslo_concurrency.lockutils [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:24:50 devstack cinder-volume[85867]: DEBUG oslo_concurrency.lockutils [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:24:50 devstack cinder-volume[85867]: DEBUG cinder.volume.drivers.quobyte [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=85867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:24:50 devstack cinder-volume[85867]: DEBUG cinder.volume.drivers.quobyte [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=85867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:24:50 devstack cinder-volume[85867]: DEBUG oslo_concurrency.lockutils [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:24:50 devstack cinder-volume[85867]: DEBUG oslo_concurrency.processutils [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=85867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:24:50 devstack sudo[85978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:24:50 devstack sudo[85978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:24:50 devstack sudo[85978]: pam_unix(sudo:session): session closed for user root Nov 06 14:24:50 devstack cinder-volume[85867]: DEBUG oslo_concurrency.processutils [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.227s {{(pid=85867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:24:50 devstack cinder-volume[85867]: DEBUG cinder.manager [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Notifying Schedulers of capabilities ... {{(pid=85867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:24:50 devstack cinder-volume[85867]: INFO cinder.volume.manager [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Driver initialization completed successfully. Nov 06 14:24:50 devstack cinder-volume[85867]: INFO cinder.manager [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Initiating service 3 cleanup Nov 06 14:24:50 devstack cinder-volume[85867]: INFO cinder.manager [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Service 3 cleanup completed. Nov 06 14:24:50 devstack cinder-volume[85867]: DEBUG cinder.service [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Creating RPC server for service cinder-volume {{(pid=85867) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 14:24:50 devstack cinder-volume[85867]: DEBUG cinder.service [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85867) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 14:24:51 devstack cinder-volume[85867]: INFO cinder.volume.manager [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 06 14:24:51 devstack cinder-volume[85867]: DEBUG oslo_concurrency.lockutils [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:24:51 devstack cinder-volume[85867]: DEBUG oslo_concurrency.lockutils [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:24:51 devstack cinder-volume[85867]: DEBUG cinder.volume.drivers.quobyte [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=85867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:24:51 devstack cinder-volume[85867]: DEBUG cinder.volume.drivers.quobyte [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=85867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:24:51 devstack cinder-volume[85867]: DEBUG oslo_concurrency.lockutils [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:24:51 devstack cinder-volume[85867]: DEBUG oslo_concurrency.processutils [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=85867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:24:51 devstack sudo[85981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:24:51 devstack sudo[85981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:24:51 devstack sudo[85981]: pam_unix(sudo:session): session closed for user root Nov 06 14:24:51 devstack cinder-volume[85867]: DEBUG oslo_concurrency.processutils [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.230s {{(pid=85867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:24:51 devstack cinder-volume[85867]: INFO cinder.volume.manager [None req-69638d8b-735e-4449-8c23-8d7d2445d89a None None] Driver post RPC initialization completed successfully. Nov 06 14:24:55 devstack cinder-volume[85867]: DEBUG oslo_concurrency.lockutils [None req-1618ab0a-68fb-416e-a9a7-83feb4f29f9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:24:55 devstack cinder-volume[85867]: DEBUG oslo_concurrency.lockutils [None req-1618ab0a-68fb-416e-a9a7-83feb4f29f9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:24:55 devstack cinder-volume[85867]: DEBUG cinder.volume.drivers.quobyte [None req-1618ab0a-68fb-416e-a9a7-83feb4f29f9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=85867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:24:55 devstack cinder-volume[85867]: DEBUG cinder.volume.drivers.quobyte [None req-1618ab0a-68fb-416e-a9a7-83feb4f29f9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=85867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:24:55 devstack cinder-volume[85867]: DEBUG oslo_concurrency.lockutils [None req-1618ab0a-68fb-416e-a9a7-83feb4f29f9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:24:55 devstack cinder-volume[85867]: DEBUG oslo_concurrency.processutils [None req-1618ab0a-68fb-416e-a9a7-83feb4f29f9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=85867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:24:55 devstack sudo[86137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:24:55 devstack sudo[86137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:24:56 devstack sudo[86137]: pam_unix(sudo:session): session closed for user root Nov 06 14:24:56 devstack cinder-volume[85867]: DEBUG oslo_concurrency.processutils [None req-1618ab0a-68fb-416e-a9a7-83feb4f29f9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.234s {{(pid=85867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:24:56 devstack cinder-volume[85867]: DEBUG cinder.manager [None req-1618ab0a-68fb-416e-a9a7-83feb4f29f9f None None] Notifying Schedulers of capabilities ... {{(pid=85867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:24:56 devstack cinder-volume[85648]: INFO oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] Caught SIGTERM, stopping children Nov 06 14:24:56 devstack cinder-volume[85648]: DEBUG oslo_concurrency.lockutils [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] Acquiring lock "singleton_lock" {{(pid=85648) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 14:24:56 devstack cinder-volume[85648]: DEBUG oslo_concurrency.lockutils [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] Acquired lock "singleton_lock" {{(pid=85648) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 14:24:56 devstack cinder-volume[85648]: DEBUG oslo_concurrency.lockutils [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] Releasing lock "singleton_lock" {{(pid=85648) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 14:24:56 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] Stop services. {{(pid=85648) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 06 14:24:56 devstack cinder-volume[85648]: DEBUG oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] Killing children. {{(pid=85648) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 06 14:24:56 devstack cinder-volume[85648]: INFO oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] Waiting on 1 children to exit Nov 06 14:24:59 devstack cinder-volume[85867]: DEBUG oslo_concurrency.lockutils [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] Acquiring lock "singleton_lock" {{(pid=85867) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 14:24:59 devstack cinder-volume[85867]: DEBUG oslo_concurrency.lockutils [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] Acquired lock "singleton_lock" {{(pid=85867) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 14:24:59 devstack cinder-volume[85867]: DEBUG oslo_concurrency.lockutils [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] Releasing lock "singleton_lock" {{(pid=85867) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 14:24:59 devstack cinder-volume[85867]: WARNING amqp [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 14:24:59 devstack cinder-volume[85867]: WARNING amqp [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 14:24:59 devstack cinder-volume[85648]: INFO oslo_service.backend._eventlet.service [None req-69acaa6b-0c1b-4f5d-b6ce-e82fe75b99a9 None None] Child 85867 exited with status 0 Nov 06 14:24:59 devstack cinder-volume[86230]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 14:24:59 devstack cinder-volume[86230]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 14:24:59 devstack cinder-volume[86230]: we strongly recommend against using it for new projects. Nov 06 14:24:59 devstack cinder-volume[86230]: If you are already using Eventlet, we recommend migrating to a different Nov 06 14:24:59 devstack cinder-volume[86230]: framework. For more detail see Nov 06 14:24:59 devstack cinder-volume[86230]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 14:24:59 devstack cinder-volume[86230]: import eventlet # noqa Nov 06 14:25:03 devstack cinder-volume[86230]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86230) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 14:25:03 devstack cinder-volume[86230]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86230) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 14:25:03 devstack cinder-volume[86230]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86230) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 14:25:03 devstack cinder-volume[86230]: INFO dbcounter [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] Registered counter for database cinder Nov 06 14:25:03 devstack cinder-volume[86230]: DEBUG oslo_db.sqlalchemy.engines [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86230) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG dbcounter [-] [86230] Writer thread running {{(pid=86230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 14:25:04 devstack cinder-volume[86230]: INFO cinder.rpc [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 14:25:04 devstack cinder-volume[86230]: INFO cinder.rpc [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_db.sqlalchemy.engines [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86230) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 14:25:04 devstack cinder-volume[86230]: INFO cinder.volume.manager [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] Determined volume DB was empty at startup. Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG cinder.volume.manager [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86230) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 06 14:25:04 devstack cinder-volume[86230]: WARNING stevedore.named [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 14:25:04 devstack cinder-volume[86230]: WARNING castellan.key_manager [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 14:25:04 devstack cinder-volume[86230]: WARNING cinder.keymgr.conf_key_mgr [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 14:25:04 devstack cinder-volume[86230]: INFO cinder.volume.manager [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_db.sqlalchemy.engines [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86230) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 14:25:04 devstack cinder-volume[86230]: INFO oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] Starting 1 workers Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] Started child 86854 {{(pid=86230) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] Full set of CONF: {{(pid=86230) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] ******************************************************************************** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] Configuration options gathered from: {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] ================================================================================ {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] allow_availability_zone_fallback = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] allow_compression_on_image_upload = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] allowed_direct_url_schemes = [] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] api_rate_limit = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] auth_strategy = keystone {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_availability_zone = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86854]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_host = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_name = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_stats_polling_interval = 60 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backup_api_class = cinder.backup.api.API {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backup_name_template = backup-%s {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backup_use_same_host = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backup_use_temp_snapshot = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] chap_password = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] chap_username = {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cinder_internal_tenant_project_id = 3e72fe74b45f42edafd367741eb68be4 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cinder_internal_tenant_user_id = 384ab531e7f14f81ab48252d790f27ba {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cluster = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] compression_format = gzip {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] compute_api_class = cinder.compute.nova.API {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] config_dir = [] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] config_source = [] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] control_exchange = openstack {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] debug = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] default_availability_zone = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] default_group_type = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] default_volume_type = QuobyteHD {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] disk_geometry = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] driver_client_cert = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] driver_client_cert_key = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] driver_data_namespace = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] driver_ssl_cert_path = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] driver_ssl_cert_verify = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] driver_use_ssl = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] enable_new_services = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] enable_unsupported_driver = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] enabled_backends = ['QuobyteHD'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] enforce_multipath_for_image_xfer = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] filter_function = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] glance_api_insecure = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] glance_api_servers = ['http://192.168.122.90/image'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] glance_api_ssl_compression = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] glance_ca_certificates_file = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] glance_catalog_info = image:glance:publicURL {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] glance_certfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] glance_keyfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] glance_num_retries = 3 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] glance_request_timeout = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] goodness_function = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] graceful_shutdown_timeout = 5 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] group_api_class = cinder.group.api.API {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] host = devstack {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] image_compress_on_upload = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] image_conversion_address_space_limit = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] image_conversion_cpu_limit = 60 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] image_conversion_disable = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] image_introspection_address_space_limit = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] image_introspection_cpu_limit = 60 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] image_upload_use_cinder_backend = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] image_upload_use_internal_tenant = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] image_volume_cache_enabled = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] image_volume_cache_max_count = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] image_volume_cache_max_size_gb = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] init_host_max_objects_retrieval = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] instance_format = [instance: %(uuid)s] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] iscsi_target_flags = {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] iscsi_write_cache = on {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] iser_helper = tgtadm {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] iser_ip_address = 192.168.122.90 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] iser_port = 3260 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] log_color = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] log_config_append = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] log_dir = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] log_file = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] log_options = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] log_rotate_interval = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] log_rotate_interval_type = days {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] log_rotation_type = none {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] max_age = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] max_logfile_count = 30 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] max_logfile_size_mb = 200 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] max_over_subscription_ratio = 20.0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] message_reap_interval = 86400 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] message_ttl = 2592000 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] migration_create_volume_timeout_secs = 300 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] monkey_patch = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] monkey_patch_modules = [] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] my_ip = 192.168.122.90 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] no_snapshot_gb_quota = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] num_iser_scan_tries = 3 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] num_shell_tries = 3 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] num_volume_device_scan_tries = 3 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] nvmeof_conn_info_version = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] nvmet_ns_id = 10 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] nvmet_port_id = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] osapi_max_limit = 1000 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] osapi_volume_ext_list = [] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] osapi_volume_listen = 0.0.0.0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] osapi_volume_listen_port = 8776 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] osapi_volume_use_ssl = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] osapi_volume_workers = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] per_volume_size_limit = -1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] periodic_fuzzy_delay = 60 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] periodic_interval = 60 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] project_id_regex = [0-9a-f\-]+ {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] public_endpoint = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] publish_errors = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] quota_backup_gigabytes = 1000 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] quota_backups = 10 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] quota_gigabytes = 1000 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] quota_groups = 10 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] quota_snapshots = 10 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] quota_volumes = 10 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] rate_limit_burst = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] rate_limit_except_level = CRITICAL {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] rate_limit_interval = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] reinit_driver_count = 3 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] replication_device = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] report_discard_supported = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] report_interval = 120 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] reservation_clean_interval = 86400 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] reservation_expire = 86400 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] reserved_image_namespaces = [] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] reserved_percentage = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] rpc_response_timeout = 120 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] run_external_periodic_tasks = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] scst_target_driver = iscsi {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] scst_target_iqn_name = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] service_down_time = 720 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] shell_completion = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] snapshot_name_template = snapshot-%s {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] split_loggers = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] state_path = /opt/stack/data/cinder {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] storage_availability_zone = nova {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] storage_protocol = iSCSI {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] syslog_log_facility = LOG_USER {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] target_helper = lioadm {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] target_ip_address = 192.168.122.90 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] target_port = 3260 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] target_protocol = iscsi {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] target_secondary_ip_addresses = [] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] trace_flags = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] transfer_api_class = cinder.transfer.api.API {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] transport_url = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] until_refresh = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] use_chap_auth = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] use_default_quota_class = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] use_journal = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] use_json = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] use_multipath_for_image_xfer = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] use_stderr = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] use_syslog = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] verify_glance_signatures = enabled {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] volume_api_class = cinder.volume.api.API {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] volume_backend_name = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] volume_clear = zero {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] volume_clear_ionice = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] volume_clear_size = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] volume_copy_bps_limit = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] volume_dd_blocksize = 1M {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] volume_name_template = volume-%s {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] volume_service_inithost_offload = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] volume_usage_audit_period = month {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] zoning_mode = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_concurrency.disable_process_locking = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.auth_section = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.auth_type = password {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.auth_version = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.cache = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.certfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.delay_auth_decision = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.http_connect_timeout = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.include_service_catalog = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.insecure = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 06 14:25:04 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86854) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.interface = public {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.keyfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.memcache_password = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.memcache_username = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.region_name = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.service_token_roles_required = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.service_type = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.token_cache_time = 300 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.90/identity {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.backend = dogpile.cache.null {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.backend_argument = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.backend_expiration_time = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.config_prefix = cache.oslo {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.debug_cache_backend = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.enable_retry_client = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.enable_socket_keepalive = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.enabled = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.expiration_time = 600 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.hashclient_retry_attempts = 2 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.memcache_dead_retry = 300 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.memcache_pool_maxsize = 10 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.memcache_sasl_enabled = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.password = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.proxies = [] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.redis_db = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.redis_sentinel_service_name = mymaster {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.redis_server = localhost:6379 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.retry_attempts = 2 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.retry_delay = 0.0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.socket_keepalive_count = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.socket_keepalive_idle = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.socket_keepalive_interval = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.socket_timeout = 1.0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.tls_allowed_ciphers = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.tls_cafile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.tls_certfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.tls_enabled = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.tls_keyfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cache.username = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] coordination.backend_url = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] database.asyncio_connection = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] database.asyncio_slave_connection = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] database.backend = sqlalchemy {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] database.connection = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] database.connection_debug = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] database.connection_parameters = {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] database.connection_recycle_time = 3600 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] database.connection_trace = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] database.db_inc_retry_interval = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] database.db_max_retries = 20 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] database.db_max_retry_interval = 10 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] database.db_retry_interval = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] database.max_overflow = 50 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] database.max_pool_size = 5 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] database.max_retries = 10 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] database.mysql_wsrep_sync_wait = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] database.pool_timeout = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] database.retry_interval = 10 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] database.slave_connection = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] database.sqlite_synchronous = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] database.synchronous_reader = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] database.use_db_reconnect = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_tracing.insecure = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] profiler.connection_string = messaging:// {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] profiler.enabled = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] profiler.es_doc_type = notification {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] profiler.es_scroll_size = 10000 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] profiler.es_scroll_time = 2m {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] profiler.filter_error_trace = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] profiler.hmac_keys = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] profiler.sentinel_service_name = mymaster {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] profiler.socket_timeout = 0.1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] profiler.trace_requests = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] profiler.trace_sqlalchemy = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] profiler_jaeger.process_tags = {} {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] profiler_jaeger.service_name_prefix = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] profiler_otlp.service_name_prefix = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_policy.enforce_new_defaults = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_policy.policy_default_rule = default {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_policy.policy_file = policy.yaml {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_policy.remote_timeout = 60.0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] privsep_osbrick.group = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] privsep_osbrick.helper_command = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] privsep_osbrick.user = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cinder_sys_admin.group = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cinder_sys_admin.helper_command = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] cinder_sys_admin.user = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] service_user.auth_section = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] service_user.auth_type = password {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] service_user.cafile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] service_user.certfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] service_user.collect_timing = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] service_user.insecure = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] service_user.keyfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] service_user.send_service_user_token = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] service_user.split_loggers = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] service_user.timeout = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] service_user.tls_ciphers = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] service_user.tls_min_version = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] glance.auth_section = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] glance.auth_type = password {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] glance.certfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] glance.collect_timing = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] glance.insecure = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] glance.keyfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] glance.region_name = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] glance.split_loggers = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] glance.timeout = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] glance.tls_ciphers = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] glance.tls_min_version = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.backend_availability_zone = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.chap_password = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.chap_username = {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.disk_geometry = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.driver_client_cert = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.driver_client_cert_key = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.driver_data_namespace = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.driver_use_ssl = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.enable_unsupported_driver = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.extra_capabilities = {} {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.filter_function = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.goodness_function = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.iscsi_target_flags = {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.iscsi_write_cache = on {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.iser_helper = tgtadm {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.iser_ip_address = 192.168.122.90 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.iser_port = 3260 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.nas_host = {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.nas_login = admin {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.nas_mount_options = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.nas_password = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.nas_private_key = {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.nas_share_path = {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.nas_ssh_port = 22 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.num_shell_tries = 3 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.nvmet_port_id = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.quobyte_client_cfg = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.quobyte_volume_url = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.replication_device = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.report_discard_supported = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.reserved_percentage = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.scst_target_driver = iscsi {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.scst_target_iqn_name = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.storage_protocol = iSCSI {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.target_helper = tgtadm {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.target_ip_address = 192.168.122.90 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.target_port = 3260 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.target_protocol = iscsi {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.trace_flags = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.unique_fqdn_network = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.use_chap_auth = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.volume_backend_name = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.volume_clear = zero {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.volume_clear_ionice = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.volume_clear_size = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_reports.file_event_handler = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_reports.log_dir = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.backend_availability_zone = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.backend_host = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.chap_password = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.chap_username = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.chiscsi_conf = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.disk_geometry = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.driver_client_cert = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.driver_client_cert_key = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.driver_data_namespace = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.driver_use_ssl = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.extra_capabilities = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.filter_function = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.goodness_function = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack quobyte-client[86864]: Reading configuration file: /etc/quobyte/client.cfg Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.iscsi_target_flags = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack quobyte-client[86864]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.iscsi_write_cache = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.iser_helper = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.iser_ip_address = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.iser_port = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.iser_target_prefix = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.nas_host = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.nas_login = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.nas_mount_options = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.nas_password = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.nas_private_key = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.nas_share_path = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.nas_ssh_port = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.num_shell_tries = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.nvmet_ns_id = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86854) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 06 14:25:05 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.quobyte [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 06 14:25:05 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.quobyte [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.nvmet_port_id = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Running cmd (subprocess): mount.quobyte {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.replication_device = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.report_discard_supported = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.reserved_percentage = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.scst_target_driver = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.storage_protocol = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.target_helper = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.target_ip_address = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.target_port = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.target_prefix = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.target_protocol = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.trace_flags = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.unique_fqdn_network = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.use_chap_auth = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.volume_clear = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.volume_clear_ionice = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.volume_clear_size = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] QuobyteHD.volumes_dir = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack sudo[86865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.ssl = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.ssl_version = {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_notifications.driver = [] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_notifications.retry = -1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] oslo_messaging_notifications.transport_url = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] key_manager.fixed_key = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican.barbican_api_version = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican.barbican_endpoint = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican.barbican_endpoint_type = public {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican.barbican_region_name = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican.cafile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican.certfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican.collect_timing = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican.insecure = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican.keyfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican.number_of_retries = 60 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican.retry_delay = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican.send_service_user_token = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican.split_loggers = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican.timeout = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican.tls_ciphers = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican.tls_min_version = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican.verify_ssl = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican.verify_ssl_path = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican_service_user.auth_section = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican_service_user.auth_type = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican_service_user.cafile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican_service_user.certfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican_service_user.collect_timing = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican_service_user.insecure = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican_service_user.keyfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican_service_user.split_loggers = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican_service_user.timeout = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican_service_user.tls_ciphers = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] barbican_service_user.tls_min_version = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] vault.approle_role_id = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] vault.approle_secret_id = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] vault.auth_method = approle {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] vault.auth_path = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] vault.kv_mountpoint = secret {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] vault.kv_path = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] vault.kv_version = 2 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] vault.namespace = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] vault.root_token_id = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] vault.ssl_ca_crt_file = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] vault.timeout = 60.0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] vault.token_file = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] vault.token_role = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] vault.use_ssl = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 14:25:05 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-40fdba09-2c51-48de-a9c9-5565e87ea0de None None] ******************************************************************************** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] CMD "mount.quobyte" returned: 1 in 0.061s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:25:05 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.246s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:25:05 devstack cinder-volume[86854]: INFO cinder.volume.driver [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Driver hasn't implemented _init_vendor_properties() Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG cinder.volume.driver [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3879013061523, 'free_capacity_gb': 1773.3879013061523, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86854) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG oslo_db.sqlalchemy.engines [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86854) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writer thread running {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG cinder.db.api [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Building query based on filter {{(pid=86854) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86854) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:25:05 devstack cinder-volume[86854]: INFO cinder.keymgr.migration [None req-d83ceffb-6c9e-491d-9989-feba63d66334 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 14:25:05 devstack sudo[86877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:25:05 devstack sudo[86877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:25:05 devstack sudo[86877]: pam_unix(sudo:session): session closed for user root Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.253s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:25:05 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Driver initialization completed successfully. Nov 06 14:25:05 devstack cinder-volume[86854]: INFO cinder.manager [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Initiating service 3 cleanup Nov 06 14:25:05 devstack cinder-volume[86854]: INFO cinder.manager [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Service 3 cleanup completed. Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG cinder.service [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Creating RPC server for service cinder-volume {{(pid=86854) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG cinder.service [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86854) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 14:25:05 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:25:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:25:05 devstack sudo[86889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:25:05 devstack sudo[86889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:25:06 devstack sudo[86889]: pam_unix(sudo:session): session closed for user root Nov 06 14:25:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.258s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:25:06 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-867381d1-32f8-469d-880e-ef5aa6b909c5 None None] Driver post RPC initialization completed successfully. Nov 06 14:25:14 devstack cinder-volume[86230]: DEBUG dbcounter [-] [86230] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:25:15 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:25:16 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=3 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:25:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager._thread_info {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:25:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread count: 6 {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 14:25:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread info: [<_MainThread(MainThread, started 130306900594816)>, , , , , ] {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Flow 'volume_create_manager' (e84f9c98-fa9b-42f3-aec3-4138789f3aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db0eeba-a951-486c-86fc-2041f47581ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db0eeba-a951-486c-86fc-2041f47581ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1054770063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c577597d2df14260a65386a135a311f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:26:04Z,use_quota=True,user_id='2ce4fa94c4554e609e7eabdeb262b55f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a8263cc-d574-4de8-9006-bcbbc9cdc2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a8263cc-d574-4de8-9006-bcbbc9cdc2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cb8e4b9-affa-4eae-bfad-e21eaf298ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cb8e4b9-affa-4eae-bfad-e21eaf298ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f', 'volume_name': 'volume-e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a57ab0d-f135-4987-98ec-e27a0939e177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a57ab0d-f135-4987-98ec-e27a0939e177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc6816d-ee35-4b02-831e-2eeff8062455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:04 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Volume e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f', 'volume_size': 1} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1054770063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c577597d2df14260a65386a135a311f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:26:04Z,use_quota=True,user_id='2ce4fa94c4554e609e7eabdeb262b55f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Creating volume e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:26:04 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:04 devstack sudo[87490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f 1073741824 Nov 06 14:26:04 devstack sudo[87490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Flow 'volume_create_manager' (cdf5da1d-a777-41ca-b602-201d503e983e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c42f48a-0bba-4cde-bad6-9ee5e263fb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Flow 'volume_create_manager' (c42458d6-d8c4-4a85-92d3-66901f3b6cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe4926b-02c1-4b96-91ed-79ccdd85c422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe4926b-02c1-4b96-91ed-79ccdd85c422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-49972356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532f3982-11f3-46cc-83ff-c04f5b32690a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e558b8e68eb418092eb5614970e25df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:26:04Z,use_quota=True,user_id='51ee91b06a4e421bab92eb29eca9f341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef78db5e-408a-417e-baca-208c781f1bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef78db5e-408a-417e-baca-208c781f1bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6200018-ecd5-4554-85c1-a682a0cd98f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6200018-ecd5-4554-85c1-a682a0cd98f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '532f3982-11f3-46cc-83ff-c04f5b32690a', 'volume_name': 'volume-532f3982-11f3-46cc-83ff-c04f5b32690a', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04aab9e4-31a2-4443-8395-576257c58d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04aab9e4-31a2-4443-8395-576257c58d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c806669d-1a97-4209-8f2c-e4fd0351a468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:04 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Volume 532f3982-11f3-46cc-83ff-c04f5b32690a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-532f3982-11f3-46cc-83ff-c04f5b32690a', 'volume_size': 1} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c42f48a-0bba-4cde-bad6-9ee5e263fb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-737182075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f9fbe2a-b26a-4abd-ad8f-e5e1cd8118df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5eda459f3f934f2a86068c663d7b3c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:26:04Z,use_quota=True,user_id='ca33333d18cb4b6494bd510db9f2fa88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4218335d-04e9-4e59-8993-b5d9b1dbb166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4218335d-04e9-4e59-8993-b5d9b1dbb166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f1d483-55d9-4c3d-852c-32391db32b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f1d483-55d9-4c3d-852c-32391db32b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f9fbe2a-b26a-4abd-ad8f-e5e1cd8118df', 'volume_name': 'volume-1f9fbe2a-b26a-4abd-ad8f-e5e1cd8118df', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99383665-31fe-454f-9a06-6bf9f3fe4ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99383665-31fe-454f-9a06-6bf9f3fe4ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1aacb6d-004c-481f-90d2-24025027af04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:04 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Volume 1f9fbe2a-b26a-4abd-ad8f-e5e1cd8118df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f9fbe2a-b26a-4abd-ad8f-e5e1cd8118df', 'volume_size': 1} Nov 06 14:26:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:26:05 devstack sudo[87490]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f 1073741824" returned: 0 in 0.743s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:05 devstack sudo[87809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f Nov 06 14:26:05 devstack sudo[87809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:05 devstack sudo[87809]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f" returned: 0 in 0.247s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:26:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:26:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.773s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:26:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-49972356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532f3982-11f3-46cc-83ff-c04f5b32690a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e558b8e68eb418092eb5614970e25df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:26:04Z,use_quota=True,user_id='51ee91b06a4e421bab92eb29eca9f341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:26:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Creating volume 532f3982-11f3-46cc-83ff-c04f5b32690a {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:26:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:26:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:26:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:26:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:26:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:26:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:26:05 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:26:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-532f3982-11f3-46cc-83ff-c04f5b32690a 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc6816d-ee35-4b02-831e-2eeff8062455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:05 devstack sudo[87812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-532f3982-11f3-46cc-83ff-c04f5b32690a 1073741824 Nov 06 14:26:05 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b459d5e5-e26e-464e-8ea2-dafb98f02438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:05 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Volume volume-e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f (e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f): created successfully Nov 06 14:26:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b459d5e5-e26e-464e-8ea2-dafb98f02438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Flow 'volume_create_manager' (e84f9c98-fa9b-42f3-aec3-4138789f3aff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:26:05 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-3b3c2e98-997d-4073-9fd6-5a3685e3afdf tempest-DeleteServersTestJSON-798420678 None] Created volume successfully. Nov 06 14:26:05 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-532f3982-11f3-46cc-83ff-c04f5b32690a 1073741824" returned: 0 in 0.545s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-532f3982-11f3-46cc-83ff-c04f5b32690a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:06 devstack sudo[87831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-532f3982-11f3-46cc-83ff-c04f5b32690a Nov 06 14:26:06 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:06 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-532f3982-11f3-46cc-83ff-c04f5b32690a" returned: 0 in 0.469s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:26:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:26:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.814s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:26:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-737182075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f9fbe2a-b26a-4abd-ad8f-e5e1cd8118df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5eda459f3f934f2a86068c663d7b3c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:26:04Z,use_quota=True,user_id='ca33333d18cb4b6494bd510db9f2fa88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:26:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Creating volume 1f9fbe2a-b26a-4abd-ad8f-e5e1cd8118df {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:26:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:26:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:26:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:26:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:26:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:26:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:26:06 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:26:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1f9fbe2a-b26a-4abd-ad8f-e5e1cd8118df 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:06 devstack sudo[87846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1f9fbe2a-b26a-4abd-ad8f-e5e1cd8118df 1073741824 Nov 06 14:26:06 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c806669d-1a97-4209-8f2c-e4fd0351a468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-532f3982-11f3-46cc-83ff-c04f5b32690a', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4abef4b1-1d1c-414a-bba7-a9b892c1e766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:06 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Volume volume-532f3982-11f3-46cc-83ff-c04f5b32690a (532f3982-11f3-46cc-83ff-c04f5b32690a): created successfully Nov 06 14:26:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4abef4b1-1d1c-414a-bba7-a9b892c1e766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Flow 'volume_create_manager' (c42458d6-d8c4-4a85-92d3-66901f3b6cc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:26:06 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-77d44871-39b9-46e7-bb06-79a22482b1e4 tempest-TaggedAttachmentsTest-725936226 None] Created volume successfully. Nov 06 14:26:07 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1f9fbe2a-b26a-4abd-ad8f-e5e1cd8118df 1073741824" returned: 0 in 0.747s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1f9fbe2a-b26a-4abd-ad8f-e5e1cd8118df {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:07 devstack sudo[87880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1f9fbe2a-b26a-4abd-ad8f-e5e1cd8118df Nov 06 14:26:07 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:07 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1f9fbe2a-b26a-4abd-ad8f-e5e1cd8118df" returned: 0 in 0.409s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:07 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:26:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:26:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1aacb6d-004c-481f-90d2-24025027af04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f9fbe2a-b26a-4abd-ad8f-e5e1cd8118df', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b516fa-71cb-4564-9462-4badbec25e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:07 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Volume volume-1f9fbe2a-b26a-4abd-ad8f-e5e1cd8118df (1f9fbe2a-b26a-4abd-ad8f-e5e1cd8118df): created successfully Nov 06 14:26:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b516fa-71cb-4564-9462-4badbec25e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Flow 'volume_create_manager' (cdf5da1d-a777-41ca-b602-201d503e983e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:26:07 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-1c0dc0c3-9a11-4df8-86eb-64e280ebbf6d tempest-VolumesTestJSON-935389879 None] Created volume successfully. Nov 06 14:26:09 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:26:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Flow 'volume_create_manager' (6bdd85ae-562f-44b9-839c-54cd0734a216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:26:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d01ce5a1-e1fe-4d92-be75-4db2922fafd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d01ce5a1-e1fe-4d92-be75-4db2922fafd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1338960520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff239ab-0a84-4896-9e6c-c29c0e83802a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5eda459f3f934f2a86068c663d7b3c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:26:09Z,use_quota=True,user_id='ca33333d18cb4b6494bd510db9f2fa88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c1dec73-ecbd-41bf-aef1-56830aed6c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c1dec73-ecbd-41bf-aef1-56830aed6c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fabc04e-5d1b-418d-96b2-0b673b47d498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fabc04e-5d1b-418d-96b2-0b673b47d498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ff239ab-0a84-4896-9e6c-c29c0e83802a', 'volume_name': 'volume-6ff239ab-0a84-4896-9e6c-c29c0e83802a', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6087e9-7d09-4ef5-bc28-cbb4a2b615a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6087e9-7d09-4ef5-bc28-cbb4a2b615a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2cc6c6-7a5f-4bd8-bbc8-81b950e1ae6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:09 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Volume 6ff239ab-0a84-4896-9e6c-c29c0e83802a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ff239ab-0a84-4896-9e6c-c29c0e83802a', 'volume_size': 1} Nov 06 14:26:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:26:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:26:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1338960520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff239ab-0a84-4896-9e6c-c29c0e83802a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5eda459f3f934f2a86068c663d7b3c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:26:09Z,use_quota=True,user_id='ca33333d18cb4b6494bd510db9f2fa88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:26:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Creating volume 6ff239ab-0a84-4896-9e6c-c29c0e83802a {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:26:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:26:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:26:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:26:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:26:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:26:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:26:09 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:26:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6ff239ab-0a84-4896-9e6c-c29c0e83802a 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:09 devstack sudo[87900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6ff239ab-0a84-4896-9e6c-c29c0e83802a 1073741824 Nov 06 14:26:09 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:09 devstack cinder-volume[86854]: WARNING py.warnings [req-02b2572a-561d-4710-abba-9784507d7691 req-25940507-bfb6-4de6-bb86-c98c16b33eab tempest-DeleteServersTestJSON-798420678 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Nov 06 14:26:09 devstack cinder-volume[86854]: .first() Nov 06 14:26:09 devstack cinder-volume[86854]: Nov 06 14:26:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-02b2572a-561d-4710-abba-9784507d7691 req-25940507-bfb6-4de6-bb86-c98c16b33eab tempest-DeleteServersTestJSON-798420678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:26:09 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6ff239ab-0a84-4896-9e6c-c29c0e83802a 1073741824" returned: 0 in 0.571s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6ff239ab-0a84-4896-9e6c-c29c0e83802a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:09 devstack sudo[87908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6ff239ab-0a84-4896-9e6c-c29c0e83802a Nov 06 14:26:09 devstack sudo[87908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:10 devstack sudo[87908]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6ff239ab-0a84-4896-9e6c-c29c0e83802a" returned: 0 in 0.285s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:10 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:26:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:26:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-02b2572a-561d-4710-abba-9784507d7691 req-25940507-bfb6-4de6-bb86-c98c16b33eab tempest-DeleteServersTestJSON-798420678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.723s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:26:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2cc6c6-7a5f-4bd8-bbc8-81b950e1ae6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ff239ab-0a84-4896-9e6c-c29c0e83802a', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92b6e1d4-144c-4520-b759-69c38d3306f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-02b2572a-561d-4710-abba-9784507d7691 req-25940507-bfb6-4de6-bb86-c98c16b33eab tempest-DeleteServersTestJSON-798420678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:26:10 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Volume volume-6ff239ab-0a84-4896-9e6c-c29c0e83802a (6ff239ab-0a84-4896-9e6c-c29c0e83802a): created successfully Nov 06 14:26:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92b6e1d4-144c-4520-b759-69c38d3306f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Flow 'volume_create_manager' (6bdd85ae-562f-44b9-839c-54cd0734a216) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:26:10 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-ae882548-4330-4c51-afdb-010b9e44743e tempest-VolumesTestJSON-935389879 None] Created volume successfully. Nov 06 14:26:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-02b2572a-561d-4710-abba-9784507d7691 req-25940507-bfb6-4de6-bb86-c98c16b33eab tempest-DeleteServersTestJSON-798420678 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e', 'name': 'volume-e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0828c122-5539-4388-ad12-17bc57bafc6b', 'enforce_multipath': True} {{(pid=86854) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 14:26:10 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-02b2572a-561d-4710-abba-9784507d7691 req-25940507-bfb6-4de6-bb86-c98c16b33eab tempest-DeleteServersTestJSON-798420678 None] attachment_update completed successfully. Nov 06 14:26:11 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:26:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Flow 'volume_create_manager' (636331ca-6386-4960-9eb2-27cd369886c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:26:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a0da7c1-22a4-47f7-8ebe-a9ebbe891fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a0da7c1-22a4-47f7-8ebe-a9ebbe891fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-117327234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df0ac49e-5dc3-4986-9dc4-f00b65870fbc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5eda459f3f934f2a86068c663d7b3c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:26:12Z,use_quota=True,user_id='ca33333d18cb4b6494bd510db9f2fa88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194f25ed-dbf4-4038-b5d5-39ab2cea702c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194f25ed-dbf4-4038-b5d5-39ab2cea702c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d074e97-e8e6-4460-a089-8f5bd25340b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d074e97-e8e6-4460-a089-8f5bd25340b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df0ac49e-5dc3-4986-9dc4-f00b65870fbc', 'volume_name': 'volume-df0ac49e-5dc3-4986-9dc4-f00b65870fbc', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd49d19-584e-4fdc-9fe1-084c2bdd0df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd49d19-584e-4fdc-9fe1-084c2bdd0df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (448fafea-361b-4da7-8363-f4af46494247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:11 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Volume df0ac49e-5dc3-4986-9dc4-f00b65870fbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df0ac49e-5dc3-4986-9dc4-f00b65870fbc', 'volume_size': 1} Nov 06 14:26:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:26:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:26:11 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-117327234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df0ac49e-5dc3-4986-9dc4-f00b65870fbc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5eda459f3f934f2a86068c663d7b3c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:26:12Z,use_quota=True,user_id='ca33333d18cb4b6494bd510db9f2fa88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:26:11 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Creating volume df0ac49e-5dc3-4986-9dc4-f00b65870fbc {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:26:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:26:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:26:11 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:26:12 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:26:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:26:12 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:26:12 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:26:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-df0ac49e-5dc3-4986-9dc4-f00b65870fbc 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:12 devstack sudo[88343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-df0ac49e-5dc3-4986-9dc4-f00b65870fbc 1073741824 Nov 06 14:26:12 devstack sudo[88343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:12 devstack sudo[88343]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-df0ac49e-5dc3-4986-9dc4-f00b65870fbc 1073741824" returned: 0 in 0.663s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-df0ac49e-5dc3-4986-9dc4-f00b65870fbc {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:12 devstack sudo[88366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-df0ac49e-5dc3-4986-9dc4-f00b65870fbc Nov 06 14:26:12 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:13 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-df0ac49e-5dc3-4986-9dc4-f00b65870fbc" returned: 0 in 0.471s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:13 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:26:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:26:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (448fafea-361b-4da7-8363-f4af46494247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df0ac49e-5dc3-4986-9dc4-f00b65870fbc', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1091680e-961d-4106-902d-5c3fb6abad20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:13 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Volume volume-df0ac49e-5dc3-4986-9dc4-f00b65870fbc (df0ac49e-5dc3-4986-9dc4-f00b65870fbc): created successfully Nov 06 14:26:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1091680e-961d-4106-902d-5c3fb6abad20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Flow 'volume_create_manager' (636331ca-6386-4960-9eb2-27cd369886c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:26:13 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-aaff088a-1a67-4859-9a5a-7afd81a9d90a tempest-VolumesTestJSON-935389879 None] Created volume successfully. Nov 06 14:26:14 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-012b3884-3953-409a-8e25-900df4adde34 req-69e7a571-718f-40ab-ae99-12e8f21f7cf4 tempest-DeleteServersTestJSON-798420678 None] Terminate volume connection completed successfully. Nov 06 14:26:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-012b3884-3953-409a-8e25-900df4adde34 req-69e7a571-718f-40ab-ae99-12e8f21f7cf4 tempest-DeleteServersTestJSON-798420678 None] Deleting attachment 0828c122-5539-4388-ad12-17bc57bafc6b. {{(pid=86854) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 14:26:15 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2911c977-9c5b-4831-9153-282f5740d5ef tempest-VolumesTestJSON-935389879 None] Acquiring lock "cinder-df0ac49e-5dc3-4986-9dc4-f00b65870fbc-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:26:15 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2911c977-9c5b-4831-9153-282f5740d5ef tempest-VolumesTestJSON-935389879 None] Lock "cinder-df0ac49e-5dc3-4986-9dc4-f00b65870fbc-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:26:15 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2911c977-9c5b-4831-9153-282f5740d5ef tempest-VolumesTestJSON-935389879 None] Acquiring lock "cinder-quobyte-df0ac49e-5dc3-4986-9dc4-f00b65870fbc" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:26:15 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2911c977-9c5b-4831-9153-282f5740d5ef tempest-VolumesTestJSON-935389879 None] Lock "cinder-quobyte-df0ac49e-5dc3-4986-9dc4-f00b65870fbc" acquired by "delete_volume" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:26:15 devstack cinder-volume[86854]: INFO oslo.privsep.daemon [None req-2911c977-9c5b-4831-9153-282f5740d5ef tempest-VolumesTestJSON-935389879 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpkfp29bxk/privsep.sock'] Nov 06 14:26:15 devstack sudo[88454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpkfp29bxk/privsep.sock Nov 06 14:26:15 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:16 devstack cinder-volume[86854]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 06 14:26:16 devstack cinder-volume[86854]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 14:26:16 devstack cinder-volume[86854]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 06 14:26:16 devstack cinder-volume[86854]: WARNING oslo.privsep.daemon [-] privsep log: Nov 06 14:26:16 devstack cinder-volume[86854]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 06 14:26:16 devstack cinder-volume[86854]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 06 14:26:16 devstack cinder-volume[86854]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 14:26:16 devstack cinder-volume[86854]: WARNING oslo.privsep.daemon [-] privsep log: Nov 06 14:26:16 devstack cinder-volume[86854]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 06 14:26:17 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:17 devstack cinder-volume[86854]: INFO oslo.privsep.daemon [None req-2911c977-9c5b-4831-9153-282f5740d5ef tempest-VolumesTestJSON-935389879 None] Spawned new privsep daemon via rootwrap Nov 06 14:26:17 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [None req-2911c977-9c5b-4831-9153-282f5740d5ef tempest-VolumesTestJSON-935389879 None] Accepted privsep connection to /tmp/tmpkfp29bxk/privsep.sock {{(pid=86854) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 06 14:26:17 devstack cinder-volume[86854]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 06 14:26:17 devstack cinder-volume[86854]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 06 14:26:17 devstack cinder-volume[86854]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 06 14:26:17 devstack cinder-volume[86854]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88459 Nov 06 14:26:17 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d5db05-2205-49a7-b17b-4ce5aa400812]: (2,) {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:26:17 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[8901ad9e-6e8d-4829-82b5-97a43180b93c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:26:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2911c977-9c5b-4831-9153-282f5740d5ef tempest-VolumesTestJSON-935389879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-df0ac49e-5dc3-4986-9dc4-f00b65870fbc {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:17 devstack sudo[88461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-df0ac49e-5dc3-4986-9dc4-f00b65870fbc Nov 06 14:26:17 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:17 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-107da9c2-3d2c-4ab9-b5bd-c6518df1e210 tempest-DeleteServersTestJSON-798420678 None] Acquiring lock "cinder-e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:26:17 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-107da9c2-3d2c-4ab9-b5bd-c6518df1e210 tempest-DeleteServersTestJSON-798420678 None] Lock "cinder-e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:26:17 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-107da9c2-3d2c-4ab9-b5bd-c6518df1e210 tempest-DeleteServersTestJSON-798420678 None] Acquiring lock "cinder-quobyte-e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:26:17 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-107da9c2-3d2c-4ab9-b5bd-c6518df1e210 tempest-DeleteServersTestJSON-798420678 None] Lock "cinder-quobyte-e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f" acquired by "delete_volume" :: waited 0.040s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:26:17 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[3debf568-af9e-40c4-a100-95dbc549d6b3]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:26:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-107da9c2-3d2c-4ab9-b5bd-c6518df1e210 tempest-DeleteServersTestJSON-798420678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:17 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2911c977-9c5b-4831-9153-282f5740d5ef tempest-VolumesTestJSON-935389879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-df0ac49e-5dc3-4986-9dc4-f00b65870fbc" returned: 0 in 0.643s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2911c977-9c5b-4831-9153-282f5740d5ef tempest-VolumesTestJSON-935389879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-df0ac49e-5dc3-4986-9dc4-f00b65870fbc {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:17 devstack sudo[88485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-df0ac49e-5dc3-4986-9dc4-f00b65870fbc Nov 06 14:26:17 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:17 devstack sudo[88479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f Nov 06 14:26:17 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:18 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2911c977-9c5b-4831-9153-282f5740d5ef tempest-VolumesTestJSON-935389879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-df0ac49e-5dc3-4986-9dc4-f00b65870fbc" returned: 0 in 0.526s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:18 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-107da9c2-3d2c-4ab9-b5bd-c6518df1e210 tempest-DeleteServersTestJSON-798420678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f" returned: 0 in 0.697s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-107da9c2-3d2c-4ab9-b5bd-c6518df1e210 tempest-DeleteServersTestJSON-798420678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2911c977-9c5b-4831-9153-282f5740d5ef tempest-VolumesTestJSON-935389879 None] Lock "cinder-quobyte-df0ac49e-5dc3-4986-9dc4-f00b65870fbc" released by "delete_volume" :: held 2.525s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:26:18 devstack sudo[88514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f Nov 06 14:26:18 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:18 devstack cinder-volume[86854]: WARNING cinder.quota [None req-2911c977-9c5b-4831-9153-282f5740d5ef tempest-VolumesTestJSON-935389879 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:26:18 devstack cinder-volume[86854]: WARNING cinder.quota [None req-2911c977-9c5b-4831-9153-282f5740d5ef tempest-VolumesTestJSON-935389879 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:26:18 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-2911c977-9c5b-4831-9153-282f5740d5ef tempest-VolumesTestJSON-935389879 None] Created reservations ['dfe343fb-3774-4b61-9d2e-ebbedd5826b2', '89c05b36-30b5-468b-acfa-8cddddd99d6a', 'e8e89412-369b-49d2-bd83-71e7b4d3f112', '1eabcb4c-615b-475c-811a-f9ce7f852f34'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:26:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2911c977-9c5b-4831-9153-282f5740d5ef tempest-VolumesTestJSON-935389879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:26:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2911c977-9c5b-4831-9153-282f5740d5ef tempest-VolumesTestJSON-935389879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:26:18 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2911c977-9c5b-4831-9153-282f5740d5ef tempest-VolumesTestJSON-935389879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:26:18 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2911c977-9c5b-4831-9153-282f5740d5ef tempest-VolumesTestJSON-935389879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:26:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2911c977-9c5b-4831-9153-282f5740d5ef tempest-VolumesTestJSON-935389879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:26:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2911c977-9c5b-4831-9153-282f5740d5ef tempest-VolumesTestJSON-935389879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:18 devstack sudo[88522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:26:18 devstack sudo[88522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:18 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-107da9c2-3d2c-4ab9-b5bd-c6518df1e210 tempest-DeleteServersTestJSON-798420678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f" returned: 0 in 0.488s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-107da9c2-3d2c-4ab9-b5bd-c6518df1e210 tempest-DeleteServersTestJSON-798420678 None] Lock "cinder-quobyte-e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f" released by "delete_volume" :: held 1.347s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:26:18 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-107da9c2-3d2c-4ab9-b5bd-c6518df1e210 tempest-DeleteServersTestJSON-798420678 None] Created reservations ['9e6064c6-d9a6-437f-89ae-137e74bd0442', 'c53aed9c-1cec-470a-bf22-a5f9a7d56e83', '534509a4-f260-476a-993a-aab4fc6cf3b3', 'e66ec0ff-dfc3-495c-9249-37d4ca61e844'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:26:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-107da9c2-3d2c-4ab9-b5bd-c6518df1e210 tempest-DeleteServersTestJSON-798420678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:26:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-107da9c2-3d2c-4ab9-b5bd-c6518df1e210 tempest-DeleteServersTestJSON-798420678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:26:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-107da9c2-3d2c-4ab9-b5bd-c6518df1e210 tempest-DeleteServersTestJSON-798420678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:26:19 devstack sudo[88522]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-107da9c2-3d2c-4ab9-b5bd-c6518df1e210 tempest-DeleteServersTestJSON-798420678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:26:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-107da9c2-3d2c-4ab9-b5bd-c6518df1e210 tempest-DeleteServersTestJSON-798420678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:26:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-107da9c2-3d2c-4ab9-b5bd-c6518df1e210 tempest-DeleteServersTestJSON-798420678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2911c977-9c5b-4831-9153-282f5740d5ef tempest-VolumesTestJSON-935389879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.463s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:19 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-2911c977-9c5b-4831-9153-282f5740d5ef tempest-VolumesTestJSON-935389879 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:26:19 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-2911c977-9c5b-4831-9153-282f5740d5ef tempest-VolumesTestJSON-935389879 None] Deleted volume successfully. Nov 06 14:26:19 devstack sudo[88534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:26:19 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2911c977-9c5b-4831-9153-282f5740d5ef tempest-VolumesTestJSON-935389879 None] Lock "cinder-df0ac49e-5dc3-4986-9dc4-f00b65870fbc-delete_volume" released by "delete_volume" :: held 3.465s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:26:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c5c59390-c541-4a99-80a4-d32d09fc15e1 tempest-VolumesTestJSON-935389879 None] Acquiring lock "cinder-6ff239ab-0a84-4896-9e6c-c29c0e83802a-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:26:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c5c59390-c541-4a99-80a4-d32d09fc15e1 tempest-VolumesTestJSON-935389879 None] Lock "cinder-6ff239ab-0a84-4896-9e6c-c29c0e83802a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:26:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c5c59390-c541-4a99-80a4-d32d09fc15e1 tempest-VolumesTestJSON-935389879 None] Acquiring lock "cinder-quobyte-6ff239ab-0a84-4896-9e6c-c29c0e83802a" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:26:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c5c59390-c541-4a99-80a4-d32d09fc15e1 tempest-VolumesTestJSON-935389879 None] Lock "cinder-quobyte-6ff239ab-0a84-4896-9e6c-c29c0e83802a" acquired by "delete_volume" :: waited 0.033s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:26:19 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[f476de40-05e4-4e50-9098-697b9760675a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:26:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c5c59390-c541-4a99-80a4-d32d09fc15e1 tempest-VolumesTestJSON-935389879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6ff239ab-0a84-4896-9e6c-c29c0e83802a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:19 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-107da9c2-3d2c-4ab9-b5bd-c6518df1e210 tempest-DeleteServersTestJSON-798420678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.393s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:19 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-107da9c2-3d2c-4ab9-b5bd-c6518df1e210 tempest-DeleteServersTestJSON-798420678 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:26:19 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-107da9c2-3d2c-4ab9-b5bd-c6518df1e210 tempest-DeleteServersTestJSON-798420678 None] Deleted volume successfully. Nov 06 14:26:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-107da9c2-3d2c-4ab9-b5bd-c6518df1e210 tempest-DeleteServersTestJSON-798420678 None] Lock "cinder-e0ae0ab5-8f7f-4e9b-a979-ecf21d1aa93f-delete_volume" released by "delete_volume" :: held 2.203s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:26:19 devstack sudo[88553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6ff239ab-0a84-4896-9e6c-c29c0e83802a Nov 06 14:26:19 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:19 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c5c59390-c541-4a99-80a4-d32d09fc15e1 tempest-VolumesTestJSON-935389879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6ff239ab-0a84-4896-9e6c-c29c0e83802a" returned: 0 in 0.520s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c5c59390-c541-4a99-80a4-d32d09fc15e1 tempest-VolumesTestJSON-935389879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6ff239ab-0a84-4896-9e6c-c29c0e83802a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:19 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6ff239ab-0a84-4896-9e6c-c29c0e83802a Nov 06 14:26:19 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:20 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c5c59390-c541-4a99-80a4-d32d09fc15e1 tempest-VolumesTestJSON-935389879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6ff239ab-0a84-4896-9e6c-c29c0e83802a" returned: 0 in 0.295s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c5c59390-c541-4a99-80a4-d32d09fc15e1 tempest-VolumesTestJSON-935389879 None] Lock "cinder-quobyte-6ff239ab-0a84-4896-9e6c-c29c0e83802a" released by "delete_volume" :: held 0.888s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:26:20 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-c5c59390-c541-4a99-80a4-d32d09fc15e1 tempest-VolumesTestJSON-935389879 None] Created reservations ['655622b3-d039-4c00-a97e-ea5e4b69060b', 'a7ec81dc-8f7a-43c3-9095-daa230e2d5c6', '32537532-960b-4cc7-9a65-08689f8e0bb7', '1ac9f848-f030-47f3-8e4b-3027b64f6f13'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:26:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c5c59390-c541-4a99-80a4-d32d09fc15e1 tempest-VolumesTestJSON-935389879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:26:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c5c59390-c541-4a99-80a4-d32d09fc15e1 tempest-VolumesTestJSON-935389879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:26:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c5c59390-c541-4a99-80a4-d32d09fc15e1 tempest-VolumesTestJSON-935389879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:26:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c5c59390-c541-4a99-80a4-d32d09fc15e1 tempest-VolumesTestJSON-935389879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:26:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c5c59390-c541-4a99-80a4-d32d09fc15e1 tempest-VolumesTestJSON-935389879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:26:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c5c59390-c541-4a99-80a4-d32d09fc15e1 tempest-VolumesTestJSON-935389879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:20 devstack sudo[88564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:26:20 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-43ac5d3d-a587-4dc7-9304-c3ea1df212cc tempest-VolumesTestJSON-935389879 None] Acquiring lock "cinder-1f9fbe2a-b26a-4abd-ad8f-e5e1cd8118df-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:26:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-43ac5d3d-a587-4dc7-9304-c3ea1df212cc tempest-VolumesTestJSON-935389879 None] Lock "cinder-1f9fbe2a-b26a-4abd-ad8f-e5e1cd8118df-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:26:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-43ac5d3d-a587-4dc7-9304-c3ea1df212cc tempest-VolumesTestJSON-935389879 None] Acquiring lock "cinder-quobyte-1f9fbe2a-b26a-4abd-ad8f-e5e1cd8118df" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:26:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-43ac5d3d-a587-4dc7-9304-c3ea1df212cc tempest-VolumesTestJSON-935389879 None] Lock "cinder-quobyte-1f9fbe2a-b26a-4abd-ad8f-e5e1cd8118df" acquired by "delete_volume" :: waited 0.061s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:26:20 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f9f947-9966-4138-80b8-2208fea09187]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:26:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-43ac5d3d-a587-4dc7-9304-c3ea1df212cc tempest-VolumesTestJSON-935389879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1f9fbe2a-b26a-4abd-ad8f-e5e1cd8118df {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:21 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c5c59390-c541-4a99-80a4-d32d09fc15e1 tempest-VolumesTestJSON-935389879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.617s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:21 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-c5c59390-c541-4a99-80a4-d32d09fc15e1 tempest-VolumesTestJSON-935389879 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:26:21 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-c5c59390-c541-4a99-80a4-d32d09fc15e1 tempest-VolumesTestJSON-935389879 None] Deleted volume successfully. Nov 06 14:26:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c5c59390-c541-4a99-80a4-d32d09fc15e1 tempest-VolumesTestJSON-935389879 None] Lock "cinder-6ff239ab-0a84-4896-9e6c-c29c0e83802a-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:26:21 devstack sudo[88570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1f9fbe2a-b26a-4abd-ad8f-e5e1cd8118df Nov 06 14:26:21 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:21 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-43ac5d3d-a587-4dc7-9304-c3ea1df212cc tempest-VolumesTestJSON-935389879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1f9fbe2a-b26a-4abd-ad8f-e5e1cd8118df" returned: 0 in 0.526s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-43ac5d3d-a587-4dc7-9304-c3ea1df212cc tempest-VolumesTestJSON-935389879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1f9fbe2a-b26a-4abd-ad8f-e5e1cd8118df {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:21 devstack sudo[88575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1f9fbe2a-b26a-4abd-ad8f-e5e1cd8118df Nov 06 14:26:21 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:21 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-43ac5d3d-a587-4dc7-9304-c3ea1df212cc tempest-VolumesTestJSON-935389879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1f9fbe2a-b26a-4abd-ad8f-e5e1cd8118df" returned: 0 in 0.327s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-43ac5d3d-a587-4dc7-9304-c3ea1df212cc tempest-VolumesTestJSON-935389879 None] Lock "cinder-quobyte-1f9fbe2a-b26a-4abd-ad8f-e5e1cd8118df" released by "delete_volume" :: held 1.001s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:26:21 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-43ac5d3d-a587-4dc7-9304-c3ea1df212cc tempest-VolumesTestJSON-935389879 None] Created reservations ['3b189cf6-ecc2-4fe7-b795-302c5f3fb9b4', '91633e38-b7d5-43e1-9acd-9b3d02297a87', 'f688fe54-b272-4fe1-886d-4c2b6cb876b8', '43b263fc-aaaf-49a3-967b-6c41520d3ca2'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:26:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-43ac5d3d-a587-4dc7-9304-c3ea1df212cc tempest-VolumesTestJSON-935389879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:26:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-43ac5d3d-a587-4dc7-9304-c3ea1df212cc tempest-VolumesTestJSON-935389879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:26:22 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-43ac5d3d-a587-4dc7-9304-c3ea1df212cc tempest-VolumesTestJSON-935389879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:26:22 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-43ac5d3d-a587-4dc7-9304-c3ea1df212cc tempest-VolumesTestJSON-935389879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:26:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-43ac5d3d-a587-4dc7-9304-c3ea1df212cc tempest-VolumesTestJSON-935389879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:26:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-43ac5d3d-a587-4dc7-9304-c3ea1df212cc tempest-VolumesTestJSON-935389879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:22 devstack sudo[88578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:26:22 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:22 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-43ac5d3d-a587-4dc7-9304-c3ea1df212cc tempest-VolumesTestJSON-935389879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.377s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:22 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-43ac5d3d-a587-4dc7-9304-c3ea1df212cc tempest-VolumesTestJSON-935389879 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:26:22 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-43ac5d3d-a587-4dc7-9304-c3ea1df212cc tempest-VolumesTestJSON-935389879 None] Deleted volume successfully. Nov 06 14:26:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-43ac5d3d-a587-4dc7-9304-c3ea1df212cc tempest-VolumesTestJSON-935389879 None] Lock "cinder-1f9fbe2a-b26a-4abd-ad8f-e5e1cd8118df-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:26:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:26:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:26:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:26:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:26:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:26:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:26:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:23 devstack sudo[88584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:26:23 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:23 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.466s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:23 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:26:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager._thread_info {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:26:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread count: 8 {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 14:26:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread info: [<_MainThread(MainThread, started 130306900594816)>, , , , , , , ] {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 14:26:31 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-555c980d-fffc-4469-95b3-13b4340a173f tempest-GroupSnapshotsV319Test-811254612 None] Group tempest-GroupSnapshotsV319Test-Group-1889715469: creating Nov 06 14:26:31 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-555c980d-fffc-4469-95b3-13b4340a173f tempest-GroupSnapshotsV319Test-811254612 None] Group tempest-GroupSnapshotsV319Test-Group-1889715469: created successfully Nov 06 14:26:31 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-555c980d-fffc-4469-95b3-13b4340a173f tempest-GroupSnapshotsV319Test-811254612 None] Create group completed successfully. Nov 06 14:26:33 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:26:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Flow 'volume_create_manager' (3583ab90-0632-435d-a88d-3ad963bde5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:26:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e184dc33-69d9-4cf6-a7f9-ecde4c0c24a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e184dc33-69d9-4cf6-a7f9-ecde4c0c24a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1389458646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3cb53b98-f722-4e47-8525-d279319b4f32,host='devstack@QuobyteHD#QuobyteHD',id=9340ab79-20e5-4c78-b7f0-a659c45d5292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd08f6adc8b34153b7d12a813097283d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:26:33Z,use_quota=True,user_id='9e78f2898e874ac99ef96b375e37db7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1945330-a742-493e-b35e-d649d4ecde38),volume_type_id=b1945330-a742-493e-b35e-d649d4ecde38)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86702a52-94c1-40c3-8959-c1ba1a6ba15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86702a52-94c1-40c3-8959-c1ba1a6ba15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd6ea88-7cf0-4374-9a38-2eaa53227449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd6ea88-7cf0-4374-9a38-2eaa53227449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9340ab79-20e5-4c78-b7f0-a659c45d5292', 'volume_name': 'volume-9340ab79-20e5-4c78-b7f0-a659c45d5292', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcdddaf6-fd8d-4671-8627-54104bb558fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcdddaf6-fd8d-4671-8627-54104bb558fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3499a55-d71f-4c24-aeb9-8a9dc226e5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:33 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Volume 9340ab79-20e5-4c78-b7f0-a659c45d5292: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9340ab79-20e5-4c78-b7f0-a659c45d5292', 'volume_size': 1} Nov 06 14:26:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:26:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:26:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3cb53b98-f722-4e47-8525-d279319b4f32,created_at=2026-11-06T13:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1389458646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3cb53b98-f722-4e47-8525-d279319b4f32,host='devstack@QuobyteHD#QuobyteHD',id=9340ab79-20e5-4c78-b7f0-a659c45d5292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd08f6adc8b34153b7d12a813097283d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:26:33Z,use_quota=True,user_id='9e78f2898e874ac99ef96b375e37db7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1945330-a742-493e-b35e-d649d4ecde38),volume_type_id=b1945330-a742-493e-b35e-d649d4ecde38)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:26:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Creating volume 9340ab79-20e5-4c78-b7f0-a659c45d5292 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:26:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:26:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:26:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:26:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:26:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:26:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:26:33 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:26:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:33 devstack sudo[88616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292 1073741824 Nov 06 14:26:33 devstack sudo[88616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:34 devstack sudo[88616]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292 1073741824" returned: 0 in 0.800s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:34 devstack sudo[88622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292 Nov 06 14:26:34 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:34 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292" returned: 0 in 0.315s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:34 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:26:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:26:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3499a55-d71f-4c24-aeb9-8a9dc226e5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9340ab79-20e5-4c78-b7f0-a659c45d5292', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (359d5dc9-79cc-498a-82e9-5b7143ae6629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:26:34 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Volume volume-9340ab79-20e5-4c78-b7f0-a659c45d5292 (9340ab79-20e5-4c78-b7f0-a659c45d5292): created successfully Nov 06 14:26:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (359d5dc9-79cc-498a-82e9-5b7143ae6629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:26:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Flow 'volume_create_manager' (3583ab90-0632-435d-a88d-3ad963bde5e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:26:34 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-6f133a30-3a68-4ba1-8830-77af537c70f3 tempest-GroupSnapshotsV319Test-811254612 None] Created volume successfully. Nov 06 14:26:36 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-9c5aae03-206d-4be0-8428-ddd85ab34858 tempest-GroupSnapshotsV319Test-811254612 None] GroupSnapshot 9aff2dd0-bac0-4322-b0d9-e30e62ba886d: creating. Nov 06 14:26:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9c5aae03-206d-4be0-8428-ddd85ab34858 tempest-GroupSnapshotsV319Test-811254612 None] Group snapshot 9aff2dd0-bac0-4322-b0d9-e30e62ba886d: creating. {{(pid=86854) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 14:26:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9c5aae03-206d-4be0-8428-ddd85ab34858 tempest-GroupSnapshotsV319Test-811254612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:26:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9c5aae03-206d-4be0-8428-ddd85ab34858 tempest-GroupSnapshotsV319Test-811254612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:26:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-9c5aae03-206d-4be0-8428-ddd85ab34858 tempest-GroupSnapshotsV319Test-811254612 None] Creating offline snapshot 04cd3d91-a3d8-4ebb-af59-e238e9c32e70 of volume 9340ab79-20e5-4c78-b7f0-a659c45d5292 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:26:36 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58182cb-233f-49cf-abbb-a16e8c4dbea6]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:26:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c5aae03-206d-4be0-8428-ddd85ab34858 tempest-GroupSnapshotsV319Test-811254612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:36 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292 Nov 06 14:26:36 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:36 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c5aae03-206d-4be0-8428-ddd85ab34858 tempest-GroupSnapshotsV319Test-811254612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292" returned: 0 in 0.446s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c5aae03-206d-4be0-8428-ddd85ab34858 tempest-GroupSnapshotsV319Test-811254612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292.04cd3d91-a3d8-4ebb-af59-e238e9c32e70 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:36 devstack sudo[88630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292.04cd3d91-a3d8-4ebb-af59-e238e9c32e70 1G Nov 06 14:26:36 devstack sudo[88630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:37 devstack sudo[88630]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c5aae03-206d-4be0-8428-ddd85ab34858 tempest-GroupSnapshotsV319Test-811254612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292.04cd3d91-a3d8-4ebb-af59-e238e9c32e70 1G" returned: 0 in 0.476s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c5aae03-206d-4be0-8428-ddd85ab34858 tempest-GroupSnapshotsV319Test-811254612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9340ab79-20e5-4c78-b7f0-a659c45d5292 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292.04cd3d91-a3d8-4ebb-af59-e238e9c32e70 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:37 devstack sudo[88636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9340ab79-20e5-4c78-b7f0-a659c45d5292 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292.04cd3d91-a3d8-4ebb-af59-e238e9c32e70 Nov 06 14:26:37 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:37 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c5aae03-206d-4be0-8428-ddd85ab34858 tempest-GroupSnapshotsV319Test-811254612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9340ab79-20e5-4c78-b7f0-a659c45d5292 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292.04cd3d91-a3d8-4ebb-af59-e238e9c32e70" returned: 0 in 0.338s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:37 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-9c5aae03-206d-4be0-8428-ddd85ab34858 tempest-GroupSnapshotsV319Test-811254612 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292.04cd3d91-a3d8-4ebb-af59-e238e9c32e70 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 14:26:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c5aae03-206d-4be0-8428-ddd85ab34858 tempest-GroupSnapshotsV319Test-811254612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292.04cd3d91-a3d8-4ebb-af59-e238e9c32e70 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:37 devstack sudo[88641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292.04cd3d91-a3d8-4ebb-af59-e238e9c32e70 Nov 06 14:26:37 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:37 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c5aae03-206d-4be0-8428-ddd85ab34858 tempest-GroupSnapshotsV319Test-811254612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292.04cd3d91-a3d8-4ebb-af59-e238e9c32e70" returned: 0 in 0.272s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c5aae03-206d-4be0-8428-ddd85ab34858 tempest-GroupSnapshotsV319Test-811254612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:37 devstack sudo[88644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292.info Nov 06 14:26:37 devstack sudo[88644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:38 devstack sudo[88644]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c5aae03-206d-4be0-8428-ddd85ab34858 tempest-GroupSnapshotsV319Test-811254612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292.info" returned: 0 in 0.295s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:38 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-9c5aae03-206d-4be0-8428-ddd85ab34858 tempest-GroupSnapshotsV319Test-811254612 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 14:26:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c5aae03-206d-4be0-8428-ddd85ab34858 tempest-GroupSnapshotsV319Test-811254612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:38 devstack sudo[88647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292.info Nov 06 14:26:38 devstack sudo[88647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:38 devstack sudo[88647]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c5aae03-206d-4be0-8428-ddd85ab34858 tempest-GroupSnapshotsV319Test-811254612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292.info" returned: 0 in 0.285s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9c5aae03-206d-4be0-8428-ddd85ab34858 tempest-GroupSnapshotsV319Test-811254612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.216s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:26:38 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-9c5aae03-206d-4be0-8428-ddd85ab34858 tempest-GroupSnapshotsV319Test-811254612 None] group_snapshot 9aff2dd0-bac0-4322-b0d9-e30e62ba886d: created successfully Nov 06 14:26:40 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-9b974788-f111-49df-b613-b0ef265ed222 tempest-GroupSnapshotsV319Test-811254612 None] group_snapshot 9aff2dd0-bac0-4322-b0d9-e30e62ba886d: deleting Nov 06 14:26:40 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9b974788-f111-49df-b613-b0ef265ed222 tempest-GroupSnapshotsV319Test-811254612 None] group_snapshot 9aff2dd0-bac0-4322-b0d9-e30e62ba886d: deleting {{(pid=86854) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 14:26:40 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9b974788-f111-49df-b613-b0ef265ed222 tempest-GroupSnapshotsV319Test-811254612 None] Acquiring lock "cinder-quobyte-9340ab79-20e5-4c78-b7f0-a659c45d5292" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:26:40 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9b974788-f111-49df-b613-b0ef265ed222 tempest-GroupSnapshotsV319Test-811254612 None] Lock "cinder-quobyte-9340ab79-20e5-4c78-b7f0-a659c45d5292" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:26:40 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9b974788-f111-49df-b613-b0ef265ed222 tempest-GroupSnapshotsV319Test-811254612 None] Acquiring lock "cinder-quobyte-04cd3d91-a3d8-4ebb-af59-e238e9c32e70" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:26:40 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9b974788-f111-49df-b613-b0ef265ed222 tempest-GroupSnapshotsV319Test-811254612 None] Lock "cinder-quobyte-04cd3d91-a3d8-4ebb-af59-e238e9c32e70" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:26:40 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-9b974788-f111-49df-b613-b0ef265ed222 tempest-GroupSnapshotsV319Test-811254612 None] Deleting offline snapshot 04cd3d91-a3d8-4ebb-af59-e238e9c32e70 of volume 9340ab79-20e5-4c78-b7f0-a659c45d5292 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:26:40 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-9b974788-f111-49df-b613-b0ef265ed222 tempest-GroupSnapshotsV319Test-811254612 None] snapshot_file for this snap is: volume-9340ab79-20e5-4c78-b7f0-a659c45d5292.04cd3d91-a3d8-4ebb-af59-e238e9c32e70 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:26:40 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8264d4-72dd-44da-8914-ee4ecbd0650b]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:26:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9b974788-f111-49df-b613-b0ef265ed222 tempest-GroupSnapshotsV319Test-811254612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292.04cd3d91-a3d8-4ebb-af59-e238e9c32e70 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:40 devstack sudo[88651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292.04cd3d91-a3d8-4ebb-af59-e238e9c32e70 Nov 06 14:26:40 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:40 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9b974788-f111-49df-b613-b0ef265ed222 tempest-GroupSnapshotsV319Test-811254612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292.04cd3d91-a3d8-4ebb-af59-e238e9c32e70" returned: 0 in 0.448s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:40 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-9b974788-f111-49df-b613-b0ef265ed222 tempest-GroupSnapshotsV319Test-811254612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9340ab79-20e5-4c78-b7f0-a659c45d5292(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:26:40 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[994e3dc5-7a22-48e3-b11a-3b120558d8d3]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:26:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9b974788-f111-49df-b613-b0ef265ed222 tempest-GroupSnapshotsV319Test-811254612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:41 devstack sudo[88656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292 Nov 06 14:26:41 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:41 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9b974788-f111-49df-b613-b0ef265ed222 tempest-GroupSnapshotsV319Test-811254612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292" returned: 0 in 0.441s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9b974788-f111-49df-b613-b0ef265ed222 tempest-GroupSnapshotsV319Test-811254612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292.04cd3d91-a3d8-4ebb-af59-e238e9c32e70 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:41 devstack sudo[88661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292.04cd3d91-a3d8-4ebb-af59-e238e9c32e70 Nov 06 14:26:41 devstack sudo[88661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:41 devstack sudo[88661]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9b974788-f111-49df-b613-b0ef265ed222 tempest-GroupSnapshotsV319Test-811254612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292.04cd3d91-a3d8-4ebb-af59-e238e9c32e70" returned: 0 in 0.399s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9b974788-f111-49df-b613-b0ef265ed222 tempest-GroupSnapshotsV319Test-811254612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292.04cd3d91-a3d8-4ebb-af59-e238e9c32e70 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:41 devstack sudo[88667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292.04cd3d91-a3d8-4ebb-af59-e238e9c32e70 Nov 06 14:26:41 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:42 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9b974788-f111-49df-b613-b0ef265ed222 tempest-GroupSnapshotsV319Test-811254612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292.04cd3d91-a3d8-4ebb-af59-e238e9c32e70" returned: 0 in 0.382s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:42 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9b974788-f111-49df-b613-b0ef265ed222 tempest-GroupSnapshotsV319Test-811254612 None] Lock "cinder-quobyte-04cd3d91-a3d8-4ebb-af59-e238e9c32e70" released by "_delete_snapshot" :: held 1.807s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:26:42 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9b974788-f111-49df-b613-b0ef265ed222 tempest-GroupSnapshotsV319Test-811254612 None] Lock "cinder-quobyte-9340ab79-20e5-4c78-b7f0-a659c45d5292" released by "delete_snapshot" :: held 1.836s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:26:42 devstack cinder-volume[86854]: WARNING cinder.quota [None req-9b974788-f111-49df-b613-b0ef265ed222 tempest-GroupSnapshotsV319Test-811254612 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1954244344 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1954244344, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:26:42 devstack cinder-volume[86854]: WARNING cinder.quota [None req-9b974788-f111-49df-b613-b0ef265ed222 tempest-GroupSnapshotsV319Test-811254612 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1954244344 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1954244344, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:26:42 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-9b974788-f111-49df-b613-b0ef265ed222 tempest-GroupSnapshotsV319Test-811254612 None] Created reservations ['50a92d31-3b79-4431-bfe5-42c43a38025c', '17972256-370a-492e-82a8-106f2c86c7e7', 'ea532fb8-514a-48ba-a413-1c8c2b11e9f6', '2bd055ae-99a4-454c-b69d-bde014f17024'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:26:42 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-9b974788-f111-49df-b613-b0ef265ed222 tempest-GroupSnapshotsV319Test-811254612 None] group_snapshot 9aff2dd0-bac0-4322-b0d9-e30e62ba886d: deleted successfully Nov 06 14:26:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1d4102aa-cd6f-4fd3-9ef3-1326a0a1850e tempest-GroupSnapshotsV319Test-811254612 None] Acquiring lock "cinder-quobyte-9340ab79-20e5-4c78-b7f0-a659c45d5292" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:26:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1d4102aa-cd6f-4fd3-9ef3-1326a0a1850e tempest-GroupSnapshotsV319Test-811254612 None] Lock "cinder-quobyte-9340ab79-20e5-4c78-b7f0-a659c45d5292" acquired by "delete_volume" :: waited 0.020s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:26:43 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[91840da1-bda5-4f0a-93cf-9ede6da2073c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:26:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1d4102aa-cd6f-4fd3-9ef3-1326a0a1850e tempest-GroupSnapshotsV319Test-811254612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:43 devstack sudo[88671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292 Nov 06 14:26:43 devstack sudo[88671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:43 devstack sudo[88671]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1d4102aa-cd6f-4fd3-9ef3-1326a0a1850e tempest-GroupSnapshotsV319Test-811254612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292" returned: 0 in 0.476s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1d4102aa-cd6f-4fd3-9ef3-1326a0a1850e tempest-GroupSnapshotsV319Test-811254612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:43 devstack sudo[88676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292 Nov 06 14:26:43 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:44 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1d4102aa-cd6f-4fd3-9ef3-1326a0a1850e tempest-GroupSnapshotsV319Test-811254612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9340ab79-20e5-4c78-b7f0-a659c45d5292" returned: 0 in 0.292s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:44 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1d4102aa-cd6f-4fd3-9ef3-1326a0a1850e tempest-GroupSnapshotsV319Test-811254612 None] Lock "cinder-quobyte-9340ab79-20e5-4c78-b7f0-a659c45d5292" released by "delete_volume" :: held 0.897s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:26:44 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-1d4102aa-cd6f-4fd3-9ef3-1326a0a1850e tempest-GroupSnapshotsV319Test-811254612 None] Created reservations ['371a5e01-4dcd-4937-b1c4-3085951d81cb'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:26:44 devstack cinder-volume[86854]: WARNING cinder.quota [None req-1d4102aa-cd6f-4fd3-9ef3-1326a0a1850e tempest-GroupSnapshotsV319Test-811254612 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1954244344 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1954244344, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:26:44 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-1d4102aa-cd6f-4fd3-9ef3-1326a0a1850e tempest-GroupSnapshotsV319Test-811254612 None] Created reservations ['013d4fff-8390-4ec3-902b-11b821bd4846', 'ebf5adbb-f524-4a0e-be80-40e34ed3aefe', '12888454-169d-4563-9281-166c52f1123b', 'edaac144-2e47-454c-bfd7-af4921ca2372'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:26:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1d4102aa-cd6f-4fd3-9ef3-1326a0a1850e tempest-GroupSnapshotsV319Test-811254612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:26:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1d4102aa-cd6f-4fd3-9ef3-1326a0a1850e tempest-GroupSnapshotsV319Test-811254612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:26:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1d4102aa-cd6f-4fd3-9ef3-1326a0a1850e tempest-GroupSnapshotsV319Test-811254612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:26:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1d4102aa-cd6f-4fd3-9ef3-1326a0a1850e tempest-GroupSnapshotsV319Test-811254612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:26:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1d4102aa-cd6f-4fd3-9ef3-1326a0a1850e tempest-GroupSnapshotsV319Test-811254612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:26:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1d4102aa-cd6f-4fd3-9ef3-1326a0a1850e tempest-GroupSnapshotsV319Test-811254612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:26:44 devstack sudo[88681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:26:44 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:26:44 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root Nov 06 14:26:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1d4102aa-cd6f-4fd3-9ef3-1326a0a1850e tempest-GroupSnapshotsV319Test-811254612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.302s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:26:44 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-1d4102aa-cd6f-4fd3-9ef3-1326a0a1850e tempest-GroupSnapshotsV319Test-811254612 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:26:44 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-1d4102aa-cd6f-4fd3-9ef3-1326a0a1850e tempest-GroupSnapshotsV319Test-811254612 None] Delete group completed successfully. Nov 06 14:26:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-fa3d0e0f-b693-4fa0-b914-433e57129372 req-d9831e5e-7836-492b-b17e-2e19a0772991 tempest-TaggedAttachmentsTest-725936226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:26:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-fa3d0e0f-b693-4fa0-b914-433e57129372 req-d9831e5e-7836-492b-b17e-2e19a0772991 tempest-TaggedAttachmentsTest-725936226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:26:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-fa3d0e0f-b693-4fa0-b914-433e57129372 req-d9831e5e-7836-492b-b17e-2e19a0772991 tempest-TaggedAttachmentsTest-725936226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:26:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-fa3d0e0f-b693-4fa0-b914-433e57129372 req-d9831e5e-7836-492b-b17e-2e19a0772991 tempest-TaggedAttachmentsTest-725936226 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e', 'name': 'volume-532f3982-11f3-46cc-83ff-c04f5b32690a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c5d5ee2b-ccd6-4a16-81ee-481c625ec8f4', 'enforce_multipath': True} {{(pid=86854) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 14:26:54 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-fa3d0e0f-b693-4fa0-b914-433e57129372 req-d9831e5e-7836-492b-b17e-2e19a0772991 tempest-TaggedAttachmentsTest-725936226 None] attachment_update completed successfully. Nov 06 14:27:00 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=77,cinder:UPDATE=72,cinder:INSERT=13,cinder:DELETE=5 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:27:00 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:UPDATE=74,cinder:SELECT=62,cinder:DELETE=5,cinder:INSERT=19 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:27:00 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-c833bc3c-cc98-4c87-bcfd-6501250017a6 req-f7288f26-6bb7-4d05-99be-4ccbef65aed8 tempest-TaggedAttachmentsTest-725936226 None] Terminate volume connection completed successfully. Nov 06 14:27:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-c833bc3c-cc98-4c87-bcfd-6501250017a6 req-f7288f26-6bb7-4d05-99be-4ccbef65aed8 tempest-TaggedAttachmentsTest-725936226 None] Deleting attachment c5d5ee2b-ccd6-4a16-81ee-481c625ec8f4. {{(pid=86854) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 14:27:16 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=1 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:27:16 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:UPDATE=1 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:27:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:27:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:27:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:27:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:27:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:27:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:27:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:23 devstack sudo[89620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:27:23 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:23 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.792s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:23 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:27:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager._thread_info {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:27:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread count: 8 {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 14:27:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread info: [<_MainThread(MainThread, started 130306900594816)>, , , , , , , ] {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 14:27:25 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-47d7573f-7910-49eb-a032-2085f0234eba tempest-TaggedAttachmentsTest-725936226 None] Acquiring lock "cinder-532f3982-11f3-46cc-83ff-c04f5b32690a-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:27:25 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-47d7573f-7910-49eb-a032-2085f0234eba tempest-TaggedAttachmentsTest-725936226 None] Lock "cinder-532f3982-11f3-46cc-83ff-c04f5b32690a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:27:25 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-47d7573f-7910-49eb-a032-2085f0234eba tempest-TaggedAttachmentsTest-725936226 None] Acquiring lock "cinder-quobyte-532f3982-11f3-46cc-83ff-c04f5b32690a" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:27:25 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-47d7573f-7910-49eb-a032-2085f0234eba tempest-TaggedAttachmentsTest-725936226 None] Lock "cinder-quobyte-532f3982-11f3-46cc-83ff-c04f5b32690a" acquired by "delete_volume" :: waited 0.026s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:27:25 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[938f6fb6-68b1-4783-81a4-fdee201d4ff1]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:27:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-47d7573f-7910-49eb-a032-2085f0234eba tempest-TaggedAttachmentsTest-725936226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-532f3982-11f3-46cc-83ff-c04f5b32690a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:25 devstack sudo[89636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-532f3982-11f3-46cc-83ff-c04f5b32690a Nov 06 14:27:25 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:26 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-47d7573f-7910-49eb-a032-2085f0234eba tempest-TaggedAttachmentsTest-725936226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-532f3982-11f3-46cc-83ff-c04f5b32690a" returned: 0 in 0.889s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-47d7573f-7910-49eb-a032-2085f0234eba tempest-TaggedAttachmentsTest-725936226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-532f3982-11f3-46cc-83ff-c04f5b32690a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:26 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-532f3982-11f3-46cc-83ff-c04f5b32690a Nov 06 14:27:26 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:26 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:27:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Flow 'volume_create_manager' (e1c43a3e-ba5f-4f7c-bf02-249ac14db647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:27:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f0ef94-4b9e-4572-9983-f770a24d76c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f0ef94-4b9e-4572-9983-f770a24d76c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2125666512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=421b2999-b620-42ea-9681-dc243a913cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a5636979bfe467fb498e1a9c4ffb114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:27:26Z,use_quota=True,user_id='a6a2deab88d646fb94330eb51276ca5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca9bd741-78a7-41e6-b79e-ee3b50cc0486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca9bd741-78a7-41e6-b79e-ee3b50cc0486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (157c027e-53cf-4e52-bf4e-6805c5940009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (157c027e-53cf-4e52-bf4e-6805c5940009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '421b2999-b620-42ea-9681-dc243a913cae', 'volume_name': 'volume-421b2999-b620-42ea-9681-dc243a913cae', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c456b1-eb93-45db-94b9-ffdfa7b48c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c456b1-eb93-45db-94b9-ffdfa7b48c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4825f47-9cb8-496b-b321-4ec729f8562c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:26 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Volume 421b2999-b620-42ea-9681-dc243a913cae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-421b2999-b620-42ea-9681-dc243a913cae', 'volume_size': 1} Nov 06 14:27:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:27:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:27:26 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2125666512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=421b2999-b620-42ea-9681-dc243a913cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a5636979bfe467fb498e1a9c4ffb114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:27:26Z,use_quota=True,user_id='a6a2deab88d646fb94330eb51276ca5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:27:26 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Creating volume 421b2999-b620-42ea-9681-dc243a913cae {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:27:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:27:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:27:26 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:27:26 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:27:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:27:26 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:27:26 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:27:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-421b2999-b620-42ea-9681-dc243a913cae 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:26 devstack sudo[89661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-421b2999-b620-42ea-9681-dc243a913cae 1073741824 Nov 06 14:27:26 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:27 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-47d7573f-7910-49eb-a032-2085f0234eba tempest-TaggedAttachmentsTest-725936226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-532f3982-11f3-46cc-83ff-c04f5b32690a" returned: 0 in 0.747s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:27 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-47d7573f-7910-49eb-a032-2085f0234eba tempest-TaggedAttachmentsTest-725936226 None] Lock "cinder-quobyte-532f3982-11f3-46cc-83ff-c04f5b32690a" released by "delete_volume" :: held 1.748s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:27:27 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-47d7573f-7910-49eb-a032-2085f0234eba tempest-TaggedAttachmentsTest-725936226 None] Created reservations ['6733fc06-0517-4e97-a288-1696c3b78ba3', '9f1a44c1-1553-4217-b262-1522578ffa42', 'e9271e65-c34f-4236-b631-02c1c58aa580', '6581740c-4e76-4068-ad6d-7198403f91f1'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:27:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-47d7573f-7910-49eb-a032-2085f0234eba tempest-TaggedAttachmentsTest-725936226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:27:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-47d7573f-7910-49eb-a032-2085f0234eba tempest-TaggedAttachmentsTest-725936226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:27:27 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-47d7573f-7910-49eb-a032-2085f0234eba tempest-TaggedAttachmentsTest-725936226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:27:27 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-47d7573f-7910-49eb-a032-2085f0234eba tempest-TaggedAttachmentsTest-725936226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:27:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-47d7573f-7910-49eb-a032-2085f0234eba tempest-TaggedAttachmentsTest-725936226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:27:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-47d7573f-7910-49eb-a032-2085f0234eba tempest-TaggedAttachmentsTest-725936226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:27 devstack sudo[89665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:27:27 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:27 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:27:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Flow 'volume_create_manager' (380dea84-2b6b-4e2f-bbe7-bfafc71cf909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:27:27 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af57b59f-282d-4f85-a390-b38b6c1ac2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-47d7573f-7910-49eb-a032-2085f0234eba tempest-TaggedAttachmentsTest-725936226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.349s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:27 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-47d7573f-7910-49eb-a032-2085f0234eba tempest-TaggedAttachmentsTest-725936226 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:27:27 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-47d7573f-7910-49eb-a032-2085f0234eba tempest-TaggedAttachmentsTest-725936226 None] Deleted volume successfully. Nov 06 14:27:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af57b59f-282d-4f85-a390-b38b6c1ac2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1853238204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d03cafb-9c4b-4825-8f83-7d0067d350a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cce1708f66a4682a9bbe733a96b4c35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:27:28Z,use_quota=True,user_id='4f1f0dd5772648dd843e63d48535d951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de13f8b-90f2-4a17-9579-a483329675f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de13f8b-90f2-4a17-9579-a483329675f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ec4e97-ca97-4993-8a75-d75dbf6abd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ec4e97-ca97-4993-8a75-d75dbf6abd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d03cafb-9c4b-4825-8f83-7d0067d350a0', 'volume_name': 'volume-2d03cafb-9c4b-4825-8f83-7d0067d350a0', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (601d5ef6-ae68-4f93-a965-4370c6320b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (601d5ef6-ae68-4f93-a965-4370c6320b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d672ad5-3820-447d-8bdf-685f5986c03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:27 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Volume 2d03cafb-9c4b-4825-8f83-7d0067d350a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d03cafb-9c4b-4825-8f83-7d0067d350a0', 'volume_size': 1} Nov 06 14:27:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:27:27 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-47d7573f-7910-49eb-a032-2085f0234eba tempest-TaggedAttachmentsTest-725936226 None] Lock "cinder-532f3982-11f3-46cc-83ff-c04f5b32690a-delete_volume" released by "delete_volume" :: held 2.639s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:27:27 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-421b2999-b620-42ea-9681-dc243a913cae 1073741824" returned: 0 in 1.288s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-421b2999-b620-42ea-9681-dc243a913cae {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:28 devstack sudo[89671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-421b2999-b620-42ea-9681-dc243a913cae Nov 06 14:27:28 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:28 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-421b2999-b620-42ea-9681-dc243a913cae" returned: 0 in 0.422s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:27:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:27:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.600s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:27:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1853238204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d03cafb-9c4b-4825-8f83-7d0067d350a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cce1708f66a4682a9bbe733a96b4c35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:27:28Z,use_quota=True,user_id='4f1f0dd5772648dd843e63d48535d951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:27:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Creating volume 2d03cafb-9c4b-4825-8f83-7d0067d350a0 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:27:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:27:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:27:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:27:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:27:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:27:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:27:28 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:27:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d03cafb-9c4b-4825-8f83-7d0067d350a0 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4825f47-9cb8-496b-b321-4ec729f8562c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-421b2999-b620-42ea-9681-dc243a913cae', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edaf499a-4802-4cbb-8a2c-624c93eb728e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:28 devstack sudo[89674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d03cafb-9c4b-4825-8f83-7d0067d350a0 1073741824 Nov 06 14:27:28 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Volume volume-421b2999-b620-42ea-9681-dc243a913cae (421b2999-b620-42ea-9681-dc243a913cae): created successfully Nov 06 14:27:28 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edaf499a-4802-4cbb-8a2c-624c93eb728e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Flow 'volume_create_manager' (e1c43a3e-ba5f-4f7c-bf02-249ac14db647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:27:28 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-f211c671-e458-4c8c-b603-777bd4c9c590 tempest-ServerRescueNegativeTestJSON-502788527 None] Created volume successfully. Nov 06 14:27:29 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d03cafb-9c4b-4825-8f83-7d0067d350a0 1073741824" returned: 0 in 0.873s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d03cafb-9c4b-4825-8f83-7d0067d350a0 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:29 devstack sudo[89681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d03cafb-9c4b-4825-8f83-7d0067d350a0 Nov 06 14:27:29 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:29 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-f8e2c622-04ba-4b2a-8e5f-fb1256d787e9 tempest-GroupsTest-780832885 None] Group tempest-Group1-187071248: creating Nov 06 14:27:29 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-f8e2c622-04ba-4b2a-8e5f-fb1256d787e9 tempest-GroupsTest-780832885 None] Group tempest-Group1-187071248: created successfully Nov 06 14:27:29 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-f8e2c622-04ba-4b2a-8e5f-fb1256d787e9 tempest-GroupsTest-780832885 None] Create group completed successfully. Nov 06 14:27:29 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d03cafb-9c4b-4825-8f83-7d0067d350a0" returned: 0 in 0.383s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:29 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:27:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:27:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d672ad5-3820-447d-8bdf-685f5986c03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d03cafb-9c4b-4825-8f83-7d0067d350a0', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e86f506-e34c-4dea-b5c9-9e066d259c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:29 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Volume volume-2d03cafb-9c4b-4825-8f83-7d0067d350a0 (2d03cafb-9c4b-4825-8f83-7d0067d350a0): created successfully Nov 06 14:27:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e86f506-e34c-4dea-b5c9-9e066d259c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Flow 'volume_create_manager' (380dea84-2b6b-4e2f-bbe7-bfafc71cf909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:27:30 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-52c540a9-eb2a-424c-ac3c-76975e6c75ae tempest-VolumesAdminNegativeTest-59898820 None] Created volume successfully. Nov 06 14:27:31 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-cd08ff83-2e06-41d0-a646-02fdfc90796a tempest-GroupsTest-780832885 None] Group tempest-Group2-2033888216: creating Nov 06 14:27:31 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-cd08ff83-2e06-41d0-a646-02fdfc90796a tempest-GroupsTest-780832885 None] Group tempest-Group2-2033888216: created successfully Nov 06 14:27:31 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-cd08ff83-2e06-41d0-a646-02fdfc90796a tempest-GroupsTest-780832885 None] Create group completed successfully. Nov 06 14:27:31 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-0dd33f41-1a7b-4140-b850-10520a49ebc1 tempest-VolumesAdminNegativeTest-59898820 None] Acquiring lock "cinder-2d03cafb-9c4b-4825-8f83-7d0067d350a0-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:27:31 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-0dd33f41-1a7b-4140-b850-10520a49ebc1 tempest-VolumesAdminNegativeTest-59898820 None] Lock "cinder-2d03cafb-9c4b-4825-8f83-7d0067d350a0-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:27:31 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-0dd33f41-1a7b-4140-b850-10520a49ebc1 tempest-VolumesAdminNegativeTest-59898820 None] Acquiring lock "cinder-quobyte-2d03cafb-9c4b-4825-8f83-7d0067d350a0" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:27:31 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-0dd33f41-1a7b-4140-b850-10520a49ebc1 tempest-VolumesAdminNegativeTest-59898820 None] Lock "cinder-quobyte-2d03cafb-9c4b-4825-8f83-7d0067d350a0" acquired by "delete_volume" :: waited 0.053s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:27:31 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3a3269-217e-4645-8331-3863f798558a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:27:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0dd33f41-1a7b-4140-b850-10520a49ebc1 tempest-VolumesAdminNegativeTest-59898820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d03cafb-9c4b-4825-8f83-7d0067d350a0 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:32 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d03cafb-9c4b-4825-8f83-7d0067d350a0 Nov 06 14:27:32 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:32 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0dd33f41-1a7b-4140-b850-10520a49ebc1 tempest-VolumesAdminNegativeTest-59898820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d03cafb-9c4b-4825-8f83-7d0067d350a0" returned: 0 in 0.845s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0dd33f41-1a7b-4140-b850-10520a49ebc1 tempest-VolumesAdminNegativeTest-59898820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d03cafb-9c4b-4825-8f83-7d0067d350a0 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:32 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d03cafb-9c4b-4825-8f83-7d0067d350a0 Nov 06 14:27:32 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:33 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:27:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Flow 'volume_create_manager' (5df21a85-4c60-415b-a7f8-7333e0e42e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:27:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b16d73e8-e4c5-4e3b-9781-a96e115e17d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b16d73e8-e4c5-4e3b-9781-a96e115e17d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-144021864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e23f5bf9-44e2-4546-910f-f29267ae0c05,host='devstack@QuobyteHD#QuobyteHD',id=a7680b2e-fd78-4c95-a07f-5069fcc5881a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5182b4fd792429d9ad03f3369524e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:27:33Z,use_quota=True,user_id='f291fa98b6f442a9bfe0136e7f00650f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fbb1b89-8de8-4e7c-ad4b-6786e9386b1e),volume_type_id=3fbb1b89-8de8-4e7c-ad4b-6786e9386b1e)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19209eb9-8d00-4da0-8a33-39ce21814f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19209eb9-8d00-4da0-8a33-39ce21814f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18a2f59-c154-4a79-92f5-4bb0b2c1e83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18a2f59-c154-4a79-92f5-4bb0b2c1e83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7680b2e-fd78-4c95-a07f-5069fcc5881a', 'volume_name': 'volume-a7680b2e-fd78-4c95-a07f-5069fcc5881a', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d7f58e-eb9c-4a0f-8bd2-7590486b214f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:33 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d7f58e-eb9c-4a0f-8bd2-7590486b214f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1ab24b7-8ae8-45e4-a72d-2d8bbe0624b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:33 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Volume a7680b2e-fd78-4c95-a07f-5069fcc5881a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7680b2e-fd78-4c95-a07f-5069fcc5881a', 'volume_size': 1} Nov 06 14:27:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:27:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:27:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e23f5bf9-44e2-4546-910f-f29267ae0c05,created_at=2026-11-06T13:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-144021864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e23f5bf9-44e2-4546-910f-f29267ae0c05,host='devstack@QuobyteHD#QuobyteHD',id=a7680b2e-fd78-4c95-a07f-5069fcc5881a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5182b4fd792429d9ad03f3369524e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:27:33Z,use_quota=True,user_id='f291fa98b6f442a9bfe0136e7f00650f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fbb1b89-8de8-4e7c-ad4b-6786e9386b1e),volume_type_id=3fbb1b89-8de8-4e7c-ad4b-6786e9386b1e)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:27:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Creating volume a7680b2e-fd78-4c95-a07f-5069fcc5881a {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:27:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:27:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:27:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:27:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:27:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:27:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:27:33 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:27:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a7680b2e-fd78-4c95-a07f-5069fcc5881a 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0dd33f41-1a7b-4140-b850-10520a49ebc1 tempest-VolumesAdminNegativeTest-59898820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d03cafb-9c4b-4825-8f83-7d0067d350a0" returned: 0 in 0.953s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-0dd33f41-1a7b-4140-b850-10520a49ebc1 tempest-VolumesAdminNegativeTest-59898820 None] Lock "cinder-quobyte-2d03cafb-9c4b-4825-8f83-7d0067d350a0" released by "delete_volume" :: held 1.934s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:27:33 devstack sudo[89729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a7680b2e-fd78-4c95-a07f-5069fcc5881a 1073741824 Nov 06 14:27:33 devstack sudo[89729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:33 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-0dd33f41-1a7b-4140-b850-10520a49ebc1 tempest-VolumesAdminNegativeTest-59898820 None] Created reservations ['d7a4234b-b73b-457a-82bb-b303b21aa984', 'efd7d5f2-e7c6-4c21-b202-0c9c105519b5', '504995ee-3474-4140-b04f-08d7de21fdb6', '1cd5da67-50a2-478a-8416-92548bfcd1ba'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:27:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-0dd33f41-1a7b-4140-b850-10520a49ebc1 tempest-VolumesAdminNegativeTest-59898820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:27:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-0dd33f41-1a7b-4140-b850-10520a49ebc1 tempest-VolumesAdminNegativeTest-59898820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:27:34 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-0dd33f41-1a7b-4140-b850-10520a49ebc1 tempest-VolumesAdminNegativeTest-59898820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:27:34 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-0dd33f41-1a7b-4140-b850-10520a49ebc1 tempest-VolumesAdminNegativeTest-59898820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:27:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-0dd33f41-1a7b-4140-b850-10520a49ebc1 tempest-VolumesAdminNegativeTest-59898820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:27:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0dd33f41-1a7b-4140-b850-10520a49ebc1 tempest-VolumesAdminNegativeTest-59898820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:34 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:27:34 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:34 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0dd33f41-1a7b-4140-b850-10520a49ebc1 tempest-VolumesAdminNegativeTest-59898820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.495s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:34 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-0dd33f41-1a7b-4140-b850-10520a49ebc1 tempest-VolumesAdminNegativeTest-59898820 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:27:34 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-0dd33f41-1a7b-4140-b850-10520a49ebc1 tempest-VolumesAdminNegativeTest-59898820 None] Deleted volume successfully. Nov 06 14:27:34 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-0dd33f41-1a7b-4140-b850-10520a49ebc1 tempest-VolumesAdminNegativeTest-59898820 None] Lock "cinder-2d03cafb-9c4b-4825-8f83-7d0067d350a0-delete_volume" released by "delete_volume" :: held 2.952s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:27:35 devstack sudo[89729]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a7680b2e-fd78-4c95-a07f-5069fcc5881a 1073741824" returned: 0 in 1.280s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a7680b2e-fd78-4c95-a07f-5069fcc5881a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:35 devstack sudo[89756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a7680b2e-fd78-4c95-a07f-5069fcc5881a Nov 06 14:27:35 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:35 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a7680b2e-fd78-4c95-a07f-5069fcc5881a" returned: 0 in 0.834s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] <== create_volume: return (2236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:27:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.258s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:27:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1ab24b7-8ae8-45e4-a72d-2d8bbe0624b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7680b2e-fd78-4c95-a07f-5069fcc5881a', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed2ae7c-6bfe-4f7b-a752-4ae828d44380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:36 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Volume volume-a7680b2e-fd78-4c95-a07f-5069fcc5881a (a7680b2e-fd78-4c95-a07f-5069fcc5881a): created successfully Nov 06 14:27:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed2ae7c-6bfe-4f7b-a752-4ae828d44380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Flow 'volume_create_manager' (5df21a85-4c60-415b-a7f8-7333e0e42e4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:27:36 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-c98f39d1-8932-4d6b-ae23-d5b5400c9083 tempest-GroupsTest-780832885 None] Created volume successfully. Nov 06 14:27:39 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b058d3d1-10ec-4020-bc45-f0399535a74b tempest-GroupsTest-780832885 None] Acquiring lock "cinder-quobyte-a7680b2e-fd78-4c95-a07f-5069fcc5881a" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:27:39 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b058d3d1-10ec-4020-bc45-f0399535a74b tempest-GroupsTest-780832885 None] Lock "cinder-quobyte-a7680b2e-fd78-4c95-a07f-5069fcc5881a" acquired by "delete_volume" :: waited 0.045s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:27:39 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07a6dac-8473-4cdd-8f7b-0462c1fa586b]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:27:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b058d3d1-10ec-4020-bc45-f0399535a74b tempest-GroupsTest-780832885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a7680b2e-fd78-4c95-a07f-5069fcc5881a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:39 devstack sudo[89772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a7680b2e-fd78-4c95-a07f-5069fcc5881a Nov 06 14:27:39 devstack sudo[89772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:39 devstack sudo[89772]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b058d3d1-10ec-4020-bc45-f0399535a74b tempest-GroupsTest-780832885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a7680b2e-fd78-4c95-a07f-5069fcc5881a" returned: 0 in 0.759s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b058d3d1-10ec-4020-bc45-f0399535a74b tempest-GroupsTest-780832885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a7680b2e-fd78-4c95-a07f-5069fcc5881a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:40 devstack sudo[89795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a7680b2e-fd78-4c95-a07f-5069fcc5881a Nov 06 14:27:40 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:40 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b058d3d1-10ec-4020-bc45-f0399535a74b tempest-GroupsTest-780832885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a7680b2e-fd78-4c95-a07f-5069fcc5881a" returned: 0 in 0.322s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:40 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b058d3d1-10ec-4020-bc45-f0399535a74b tempest-GroupsTest-780832885 None] Lock "cinder-quobyte-a7680b2e-fd78-4c95-a07f-5069fcc5881a" released by "delete_volume" :: held 1.154s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:27:40 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-b058d3d1-10ec-4020-bc45-f0399535a74b tempest-GroupsTest-780832885 None] Created reservations ['e658cdaf-acf6-4e1f-a2cb-f1ff4814a6e3'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:27:40 devstack cinder-volume[86854]: WARNING cinder.quota [None req-b058d3d1-10ec-4020-bc45-f0399535a74b tempest-GroupsTest-780832885 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-506360625 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-506360625, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:27:40 devstack cinder-volume[86854]: WARNING cinder.quota [None req-b058d3d1-10ec-4020-bc45-f0399535a74b tempest-GroupsTest-780832885 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-506360625 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-506360625, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:27:40 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-b058d3d1-10ec-4020-bc45-f0399535a74b tempest-GroupsTest-780832885 None] Created reservations ['57ea9456-11fd-4805-a526-1c418ed85a61', '4c6fd021-ba4f-4dbe-ad21-a30eaf7cd679', 'faeca172-aa3c-4b50-8ecc-a8fcbc029f93', '51f95f1a-a088-4152-b836-3660c4b89c89'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:27:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b058d3d1-10ec-4020-bc45-f0399535a74b tempest-GroupsTest-780832885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:27:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b058d3d1-10ec-4020-bc45-f0399535a74b tempest-GroupsTest-780832885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:27:40 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b058d3d1-10ec-4020-bc45-f0399535a74b tempest-GroupsTest-780832885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:27:40 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b058d3d1-10ec-4020-bc45-f0399535a74b tempest-GroupsTest-780832885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:27:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b058d3d1-10ec-4020-bc45-f0399535a74b tempest-GroupsTest-780832885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:27:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b058d3d1-10ec-4020-bc45-f0399535a74b tempest-GroupsTest-780832885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:40 devstack sudo[89798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:27:40 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:41 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-92253e33-2ef7-4b1b-b742-c2ad7ac73816 tempest-GroupsTest-780832885 None] Created reservations ['47649e5e-ec76-4b02-97c7-f9d101412fa2'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:27:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-92253e33-2ef7-4b1b-b742-c2ad7ac73816 tempest-GroupsTest-780832885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:27:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-92253e33-2ef7-4b1b-b742-c2ad7ac73816 tempest-GroupsTest-780832885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:27:41 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-92253e33-2ef7-4b1b-b742-c2ad7ac73816 tempest-GroupsTest-780832885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:27:41 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-92253e33-2ef7-4b1b-b742-c2ad7ac73816 tempest-GroupsTest-780832885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:27:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-92253e33-2ef7-4b1b-b742-c2ad7ac73816 tempest-GroupsTest-780832885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:27:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-92253e33-2ef7-4b1b-b742-c2ad7ac73816 tempest-GroupsTest-780832885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:41 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b058d3d1-10ec-4020-bc45-f0399535a74b tempest-GroupsTest-780832885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.571s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:41 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-b058d3d1-10ec-4020-bc45-f0399535a74b tempest-GroupsTest-780832885 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:27:41 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-b058d3d1-10ec-4020-bc45-f0399535a74b tempest-GroupsTest-780832885 None] Delete group completed successfully. Nov 06 14:27:41 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:27:41 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:41 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-92253e33-2ef7-4b1b-b742-c2ad7ac73816 tempest-GroupsTest-780832885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.305s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:41 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-92253e33-2ef7-4b1b-b742-c2ad7ac73816 tempest-GroupsTest-780832885 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:27:41 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-92253e33-2ef7-4b1b-b742-c2ad7ac73816 tempest-GroupsTest-780832885 None] Delete group completed successfully. Nov 06 14:27:42 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-c3c03620-37e7-4069-bef8-9e3e58424bd1 tempest-GroupsTest-780832885 None] Group tempest-GroupsTest-Group-857615328: creating Nov 06 14:27:42 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-c3c03620-37e7-4069-bef8-9e3e58424bd1 tempest-GroupsTest-780832885 None] Group tempest-GroupsTest-Group-857615328: created successfully Nov 06 14:27:42 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-c3c03620-37e7-4069-bef8-9e3e58424bd1 tempest-GroupsTest-780832885 None] Create group completed successfully. Nov 06 14:27:44 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:27:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Flow 'volume_create_manager' (eecd52df-813d-40c9-a3b9-c05feacdf26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:27:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f59d09dc-01e9-4f9a-a071-027cb7e15882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f59d09dc-01e9-4f9a-a071-027cb7e15882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1448872225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b2630d5c-c3c2-41ee-8633-fb1e5d730e10,host='devstack@QuobyteHD#QuobyteHD',id=5931c458-79f6-42ab-9658-c28f71da28c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5182b4fd792429d9ad03f3369524e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:27:45Z,use_quota=True,user_id='f291fa98b6f442a9bfe0136e7f00650f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c95fa7e9-ad34-48bf-87ab-1d3ed2c1651e),volume_type_id=c95fa7e9-ad34-48bf-87ab-1d3ed2c1651e)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d9dd8f-f55c-4aec-91b7-e2c7611cbff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d9dd8f-f55c-4aec-91b7-e2c7611cbff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b84d02d-39a8-407d-9ed3-f7389f376319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b84d02d-39a8-407d-9ed3-f7389f376319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5931c458-79f6-42ab-9658-c28f71da28c5', 'volume_name': 'volume-5931c458-79f6-42ab-9658-c28f71da28c5', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0511176d-0de2-4f6f-81a0-436dbf2714ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0511176d-0de2-4f6f-81a0-436dbf2714ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aedfbb75-b560-4eb7-bb2f-1da220b55b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:44 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Volume 5931c458-79f6-42ab-9658-c28f71da28c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5931c458-79f6-42ab-9658-c28f71da28c5', 'volume_size': 1} Nov 06 14:27:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:27:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:27:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b2630d5c-c3c2-41ee-8633-fb1e5d730e10,created_at=2026-11-06T13:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1448872225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b2630d5c-c3c2-41ee-8633-fb1e5d730e10,host='devstack@QuobyteHD#QuobyteHD',id=5931c458-79f6-42ab-9658-c28f71da28c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5182b4fd792429d9ad03f3369524e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:27:45Z,use_quota=True,user_id='f291fa98b6f442a9bfe0136e7f00650f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c95fa7e9-ad34-48bf-87ab-1d3ed2c1651e),volume_type_id=c95fa7e9-ad34-48bf-87ab-1d3ed2c1651e)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:27:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Creating volume 5931c458-79f6-42ab-9658-c28f71da28c5 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:27:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:27:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:27:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:27:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:27:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:27:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:27:44 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:27:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5931c458-79f6-42ab-9658-c28f71da28c5 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:45 devstack sudo[89807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5931c458-79f6-42ab-9658-c28f71da28c5 1073741824 Nov 06 14:27:45 devstack sudo[89807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:45 devstack sudo[89807]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5931c458-79f6-42ab-9658-c28f71da28c5 1073741824" returned: 0 in 0.752s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5931c458-79f6-42ab-9658-c28f71da28c5 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:45 devstack sudo[89822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5931c458-79f6-42ab-9658-c28f71da28c5 Nov 06 14:27:45 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:46 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5931c458-79f6-42ab-9658-c28f71da28c5" returned: 0 in 0.391s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:46 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:27:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:27:46 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aedfbb75-b560-4eb7-bb2f-1da220b55b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5931c458-79f6-42ab-9658-c28f71da28c5', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:46 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aa06fd8-76f5-410a-9cb7-c7b6cced5ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:46 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Volume volume-5931c458-79f6-42ab-9658-c28f71da28c5 (5931c458-79f6-42ab-9658-c28f71da28c5): created successfully Nov 06 14:27:46 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aa06fd8-76f5-410a-9cb7-c7b6cced5ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:46 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Flow 'volume_create_manager' (eecd52df-813d-40c9-a3b9-c05feacdf26a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:27:46 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-10851777-2068-4b91-af0c-3aab41bb71bb tempest-GroupsTest-780832885 None] Created volume successfully. Nov 06 14:27:48 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:27:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Flow 'volume_create_manager' (e742cd70-dfeb-425a-a39d-2b012f16ce30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:27:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fbebfb6-595c-4016-9be1-e369c5361790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fbebfb6-595c-4016-9be1-e369c5361790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-852841840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b2630d5c-c3c2-41ee-8633-fb1e5d730e10,host='devstack@QuobyteHD#QuobyteHD',id=6ddd9993-3680-42e0-bb19-fb94a4521189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5182b4fd792429d9ad03f3369524e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:27:48Z,use_quota=True,user_id='f291fa98b6f442a9bfe0136e7f00650f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c95fa7e9-ad34-48bf-87ab-1d3ed2c1651e),volume_type_id=c95fa7e9-ad34-48bf-87ab-1d3ed2c1651e)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b76a269-3398-4f7e-bd26-b1613a5f174f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b76a269-3398-4f7e-bd26-b1613a5f174f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0e0dd2-c9f2-4e12-8663-b0dbdd407496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0e0dd2-c9f2-4e12-8663-b0dbdd407496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ddd9993-3680-42e0-bb19-fb94a4521189', 'volume_name': 'volume-6ddd9993-3680-42e0-bb19-fb94a4521189', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec9f0d09-ed3a-46cc-a259-d32e5f1c31f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec9f0d09-ed3a-46cc-a259-d32e5f1c31f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de57589f-8b1f-4df2-9ccc-8127461ef752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:48 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Volume 6ddd9993-3680-42e0-bb19-fb94a4521189: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ddd9993-3680-42e0-bb19-fb94a4521189', 'volume_size': 1} Nov 06 14:27:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:27:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:27:48 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b2630d5c-c3c2-41ee-8633-fb1e5d730e10,created_at=2026-11-06T13:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-852841840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b2630d5c-c3c2-41ee-8633-fb1e5d730e10,host='devstack@QuobyteHD#QuobyteHD',id=6ddd9993-3680-42e0-bb19-fb94a4521189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5182b4fd792429d9ad03f3369524e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:27:48Z,use_quota=True,user_id='f291fa98b6f442a9bfe0136e7f00650f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c95fa7e9-ad34-48bf-87ab-1d3ed2c1651e),volume_type_id=c95fa7e9-ad34-48bf-87ab-1d3ed2c1651e)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:27:48 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Creating volume 6ddd9993-3680-42e0-bb19-fb94a4521189 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:27:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:27:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:27:48 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:27:48 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:27:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:27:48 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:27:48 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:27:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6ddd9993-3680-42e0-bb19-fb94a4521189 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:48 devstack sudo[89848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6ddd9993-3680-42e0-bb19-fb94a4521189 1073741824 Nov 06 14:27:48 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:49 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a845d775-51bf-414d-8c1f-8854366d909f tempest-ServerRescueNegativeTestJSON-502788527 None] Acquiring lock "cinder-421b2999-b620-42ea-9681-dc243a913cae-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:27:49 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a845d775-51bf-414d-8c1f-8854366d909f tempest-ServerRescueNegativeTestJSON-502788527 None] Lock "cinder-421b2999-b620-42ea-9681-dc243a913cae-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:27:49 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a845d775-51bf-414d-8c1f-8854366d909f tempest-ServerRescueNegativeTestJSON-502788527 None] Acquiring lock "cinder-quobyte-421b2999-b620-42ea-9681-dc243a913cae" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:27:49 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a845d775-51bf-414d-8c1f-8854366d909f tempest-ServerRescueNegativeTestJSON-502788527 None] Lock "cinder-quobyte-421b2999-b620-42ea-9681-dc243a913cae" acquired by "delete_volume" :: waited 0.037s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:27:49 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[a518b013-36f5-41cb-8670-6ca34f69286f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:27:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a845d775-51bf-414d-8c1f-8854366d909f tempest-ServerRescueNegativeTestJSON-502788527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-421b2999-b620-42ea-9681-dc243a913cae {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:49 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6ddd9993-3680-42e0-bb19-fb94a4521189 1073741824" returned: 0 in 1.006s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6ddd9993-3680-42e0-bb19-fb94a4521189 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:49 devstack sudo[89856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6ddd9993-3680-42e0-bb19-fb94a4521189 Nov 06 14:27:49 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:49 devstack sudo[89854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-421b2999-b620-42ea-9681-dc243a913cae Nov 06 14:27:49 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:50 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a845d775-51bf-414d-8c1f-8854366d909f tempest-ServerRescueNegativeTestJSON-502788527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-421b2999-b620-42ea-9681-dc243a913cae" returned: 0 in 0.678s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a845d775-51bf-414d-8c1f-8854366d909f tempest-ServerRescueNegativeTestJSON-502788527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-421b2999-b620-42ea-9681-dc243a913cae {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:50 devstack sudo[89863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-421b2999-b620-42ea-9681-dc243a913cae Nov 06 14:27:50 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:50 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6ddd9993-3680-42e0-bb19-fb94a4521189" returned: 0 in 0.516s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:50 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:27:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:27:50 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de57589f-8b1f-4df2-9ccc-8127461ef752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ddd9993-3680-42e0-bb19-fb94a4521189', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:50 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63bfc6a-2f4e-4dfe-8ef0-9ee30fb7e312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:27:50 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Volume volume-6ddd9993-3680-42e0-bb19-fb94a4521189 (6ddd9993-3680-42e0-bb19-fb94a4521189): created successfully Nov 06 14:27:50 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63bfc6a-2f4e-4dfe-8ef0-9ee30fb7e312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:27:50 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Flow 'volume_create_manager' (e742cd70-dfeb-425a-a39d-2b012f16ce30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:27:50 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-48dc8837-9485-40fe-b59a-a3719e6d6088 tempest-GroupsTest-780832885 None] Created volume successfully. Nov 06 14:27:50 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a845d775-51bf-414d-8c1f-8854366d909f tempest-ServerRescueNegativeTestJSON-502788527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-421b2999-b620-42ea-9681-dc243a913cae" returned: 0 in 0.411s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:50 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a845d775-51bf-414d-8c1f-8854366d909f tempest-ServerRescueNegativeTestJSON-502788527 None] Lock "cinder-quobyte-421b2999-b620-42ea-9681-dc243a913cae" released by "delete_volume" :: held 1.176s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:27:50 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-a845d775-51bf-414d-8c1f-8854366d909f tempest-ServerRescueNegativeTestJSON-502788527 None] Created reservations ['6778090f-8c88-4574-8b82-1b1fdbf45d2d', '08126fa7-e812-457c-9097-cd64589a0253', '47864998-d7ac-49b3-9ba1-11f5d3bb0eaa', 'b12ddb9c-fdac-4704-a92a-fa7ba644012c'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:27:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a845d775-51bf-414d-8c1f-8854366d909f tempest-ServerRescueNegativeTestJSON-502788527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:27:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a845d775-51bf-414d-8c1f-8854366d909f tempest-ServerRescueNegativeTestJSON-502788527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:27:50 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a845d775-51bf-414d-8c1f-8854366d909f tempest-ServerRescueNegativeTestJSON-502788527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:27:50 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a845d775-51bf-414d-8c1f-8854366d909f tempest-ServerRescueNegativeTestJSON-502788527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:27:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a845d775-51bf-414d-8c1f-8854366d909f tempest-ServerRescueNegativeTestJSON-502788527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:27:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a845d775-51bf-414d-8c1f-8854366d909f tempest-ServerRescueNegativeTestJSON-502788527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:50 devstack sudo[89866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:27:50 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:51 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a845d775-51bf-414d-8c1f-8854366d909f tempest-ServerRescueNegativeTestJSON-502788527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.526s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:51 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-a845d775-51bf-414d-8c1f-8854366d909f tempest-ServerRescueNegativeTestJSON-502788527 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:27:51 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-a845d775-51bf-414d-8c1f-8854366d909f tempest-ServerRescueNegativeTestJSON-502788527 None] Deleted volume successfully. Nov 06 14:27:51 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a845d775-51bf-414d-8c1f-8854366d909f tempest-ServerRescueNegativeTestJSON-502788527 None] Lock "cinder-421b2999-b620-42ea-9681-dc243a913cae-delete_volume" released by "delete_volume" :: held 2.138s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:27:51 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-cb434b3b-d929-4c21-a659-8f3b722e20b9 tempest-GroupsTest-780832885 None] Update group completed successfully. Nov 06 14:27:53 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-baba9682-6417-4215-a3d0-6cfb778a6467 tempest-GroupsTest-780832885 None] Update group completed successfully. Nov 06 14:27:55 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6d6ddeea-e96c-42d0-a06b-57135ac5b2fb tempest-GroupsTest-780832885 None] Acquiring lock "cinder-quobyte-5931c458-79f6-42ab-9658-c28f71da28c5" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:27:55 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6d6ddeea-e96c-42d0-a06b-57135ac5b2fb tempest-GroupsTest-780832885 None] Lock "cinder-quobyte-5931c458-79f6-42ab-9658-c28f71da28c5" acquired by "delete_volume" :: waited 0.028s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:27:55 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc870ebf-d7e3-4291-a6eb-d649e7b8ae93]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:27:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6d6ddeea-e96c-42d0-a06b-57135ac5b2fb tempest-GroupsTest-780832885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5931c458-79f6-42ab-9658-c28f71da28c5 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:55 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5931c458-79f6-42ab-9658-c28f71da28c5 Nov 06 14:27:55 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:56 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6d6ddeea-e96c-42d0-a06b-57135ac5b2fb tempest-GroupsTest-780832885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5931c458-79f6-42ab-9658-c28f71da28c5" returned: 0 in 0.646s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6d6ddeea-e96c-42d0-a06b-57135ac5b2fb tempest-GroupsTest-780832885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5931c458-79f6-42ab-9658-c28f71da28c5 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:56 devstack sudo[89909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5931c458-79f6-42ab-9658-c28f71da28c5 Nov 06 14:27:56 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:56 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6d6ddeea-e96c-42d0-a06b-57135ac5b2fb tempest-GroupsTest-780832885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5931c458-79f6-42ab-9658-c28f71da28c5" returned: 0 in 0.317s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:56 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6d6ddeea-e96c-42d0-a06b-57135ac5b2fb tempest-GroupsTest-780832885 None] Lock "cinder-quobyte-5931c458-79f6-42ab-9658-c28f71da28c5" released by "delete_volume" :: held 1.035s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:27:56 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6d6ddeea-e96c-42d0-a06b-57135ac5b2fb tempest-GroupsTest-780832885 None] Acquiring lock "cinder-quobyte-6ddd9993-3680-42e0-bb19-fb94a4521189" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:27:56 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6d6ddeea-e96c-42d0-a06b-57135ac5b2fb tempest-GroupsTest-780832885 None] Lock "cinder-quobyte-6ddd9993-3680-42e0-bb19-fb94a4521189" acquired by "delete_volume" :: waited 0.021s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:27:56 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49450d6-a708-44fe-ba18-c655238682cc]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:27:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6d6ddeea-e96c-42d0-a06b-57135ac5b2fb tempest-GroupsTest-780832885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6ddd9993-3680-42e0-bb19-fb94a4521189 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:56 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6ddd9993-3680-42e0-bb19-fb94a4521189 Nov 06 14:27:56 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:57 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6d6ddeea-e96c-42d0-a06b-57135ac5b2fb tempest-GroupsTest-780832885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6ddd9993-3680-42e0-bb19-fb94a4521189" returned: 0 in 0.618s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6d6ddeea-e96c-42d0-a06b-57135ac5b2fb tempest-GroupsTest-780832885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6ddd9993-3680-42e0-bb19-fb94a4521189 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:57 devstack sudo[89918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6ddd9993-3680-42e0-bb19-fb94a4521189 Nov 06 14:27:57 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:57 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6d6ddeea-e96c-42d0-a06b-57135ac5b2fb tempest-GroupsTest-780832885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6ddd9993-3680-42e0-bb19-fb94a4521189" returned: 0 in 0.319s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:57 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6d6ddeea-e96c-42d0-a06b-57135ac5b2fb tempest-GroupsTest-780832885 None] Lock "cinder-quobyte-6ddd9993-3680-42e0-bb19-fb94a4521189" released by "delete_volume" :: held 1.005s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:27:57 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-6d6ddeea-e96c-42d0-a06b-57135ac5b2fb tempest-GroupsTest-780832885 None] Created reservations ['163ef528-6b16-4aed-bd1a-3b4a8a7618ab'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:27:57 devstack cinder-volume[86854]: WARNING cinder.quota [None req-6d6ddeea-e96c-42d0-a06b-57135ac5b2fb tempest-GroupsTest-780832885 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1768446288 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1768446288, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:27:57 devstack cinder-volume[86854]: WARNING cinder.quota [None req-6d6ddeea-e96c-42d0-a06b-57135ac5b2fb tempest-GroupsTest-780832885 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1768446288 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1768446288, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:27:57 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-6d6ddeea-e96c-42d0-a06b-57135ac5b2fb tempest-GroupsTest-780832885 None] Created reservations ['659afa2a-ad47-48f0-83c0-32c521c35512', 'd89688bc-4f02-42c1-ba29-f3a81f5fc5e6', 'bf9f20ef-0085-4bae-b8fe-f12ef5e2c3f1', '4ef5f449-a98c-467e-ba4b-cc39eb03a92c'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:27:57 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-6d6ddeea-e96c-42d0-a06b-57135ac5b2fb tempest-GroupsTest-780832885 None] Created reservations ['936b6c3d-f80b-4cf4-8b91-bfd5a8aac1e7', '83dbf88e-39fb-4785-87af-e761fc4cd155', '677d7c2b-3a02-4ffa-a1f5-765477c62cc1', '68ddbc39-9762-46b3-b93a-ec395a3664e4'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:27:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6d6ddeea-e96c-42d0-a06b-57135ac5b2fb tempest-GroupsTest-780832885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:27:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6d6ddeea-e96c-42d0-a06b-57135ac5b2fb tempest-GroupsTest-780832885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:27:57 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6d6ddeea-e96c-42d0-a06b-57135ac5b2fb tempest-GroupsTest-780832885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:27:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6d6ddeea-e96c-42d0-a06b-57135ac5b2fb tempest-GroupsTest-780832885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:27:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6d6ddeea-e96c-42d0-a06b-57135ac5b2fb tempest-GroupsTest-780832885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:27:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6d6ddeea-e96c-42d0-a06b-57135ac5b2fb tempest-GroupsTest-780832885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:27:58 devstack sudo[89935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:27:58 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:27:58 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root Nov 06 14:27:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6d6ddeea-e96c-42d0-a06b-57135ac5b2fb tempest-GroupsTest-780832885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.368s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:27:58 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-6d6ddeea-e96c-42d0-a06b-57135ac5b2fb tempest-GroupsTest-780832885 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:27:58 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-6d6ddeea-e96c-42d0-a06b-57135ac5b2fb tempest-GroupsTest-780832885 None] Delete group completed successfully. Nov 06 14:28:07 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:UPDATE=75,cinder:SELECT=57,cinder:INSERT=14,cinder:DELETE=4 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:28:07 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=63,cinder:UPDATE=76,cinder:INSERT=18,cinder:DELETE=4 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:28:09 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-4275b33a-4041-4d7d-8cc6-720915adb153 tempest-GroupsV320Test-1482915828 None] Group tempest-GroupsV320Test-Group-325556650: creating Nov 06 14:28:09 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-4275b33a-4041-4d7d-8cc6-720915adb153 tempest-GroupsV320Test-1482915828 None] Group tempest-GroupsV320Test-Group-325556650: created successfully Nov 06 14:28:09 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-4275b33a-4041-4d7d-8cc6-720915adb153 tempest-GroupsV320Test-1482915828 None] Create group completed successfully. Nov 06 14:28:11 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-ef5d55d2-f2d5-4a59-823a-9f4e20027ee2 tempest-GroupsV320Test-1482915828 None] Created reservations ['00d841d5-6a20-45b4-9625-7cf503efd06f'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:28:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ef5d55d2-f2d5-4a59-823a-9f4e20027ee2 tempest-GroupsV320Test-1482915828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:28:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ef5d55d2-f2d5-4a59-823a-9f4e20027ee2 tempest-GroupsV320Test-1482915828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:28:11 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ef5d55d2-f2d5-4a59-823a-9f4e20027ee2 tempest-GroupsV320Test-1482915828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:28:11 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ef5d55d2-f2d5-4a59-823a-9f4e20027ee2 tempest-GroupsV320Test-1482915828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:28:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ef5d55d2-f2d5-4a59-823a-9f4e20027ee2 tempest-GroupsV320Test-1482915828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:28:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ef5d55d2-f2d5-4a59-823a-9f4e20027ee2 tempest-GroupsV320Test-1482915828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:28:11 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:28:11 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:28:11 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Nov 06 14:28:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ef5d55d2-f2d5-4a59-823a-9f4e20027ee2 tempest-GroupsV320Test-1482915828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.329s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:28:11 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-ef5d55d2-f2d5-4a59-823a-9f4e20027ee2 tempest-GroupsV320Test-1482915828 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:28:11 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-ef5d55d2-f2d5-4a59-823a-9f4e20027ee2 tempest-GroupsV320Test-1482915828 None] Delete group completed successfully. Nov 06 14:28:15 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:28:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Flow 'volume_create_manager' (af4c586f-197b-46b5-a9f5-3352e0ba2cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:28:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c881d8e-af24-464c-9788-8f75b531c76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c881d8e-af24-464c-9788-8f75b531c76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1789673914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c25737-6e3a-4fc1-887b-eadc2e511671,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e9352aaff424a899238e5273d6272d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:28:15Z,use_quota=True,user_id='dc150935cdcf4e92b39e85c7cab7da18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d8a700-07bb-4b98-b665-2f19ed0c96e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d8a700-07bb-4b98-b665-2f19ed0c96e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7fb9f5-d987-449a-8505-6c8d5b77811b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7fb9f5-d987-449a-8505-6c8d5b77811b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44c25737-6e3a-4fc1-887b-eadc2e511671', 'volume_name': 'volume-44c25737-6e3a-4fc1-887b-eadc2e511671', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ee91b1-5267-4b7a-8074-acdb10913cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ee91b1-5267-4b7a-8074-acdb10913cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaa96605-4538-4359-97fd-d8dc95e91d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:15 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Volume 44c25737-6e3a-4fc1-887b-eadc2e511671: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44c25737-6e3a-4fc1-887b-eadc2e511671', 'volume_size': 1} Nov 06 14:28:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:28:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:28:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1789673914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c25737-6e3a-4fc1-887b-eadc2e511671,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e9352aaff424a899238e5273d6272d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:28:15Z,use_quota=True,user_id='dc150935cdcf4e92b39e85c7cab7da18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:28:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Creating volume 44c25737-6e3a-4fc1-887b-eadc2e511671 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:28:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:28:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:28:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:28:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:28:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:28:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:28:15 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:28:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-44c25737-6e3a-4fc1-887b-eadc2e511671 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:28:15 devstack sudo[90101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-44c25737-6e3a-4fc1-887b-eadc2e511671 1073741824 Nov 06 14:28:15 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:28:16 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root Nov 06 14:28:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-44c25737-6e3a-4fc1-887b-eadc2e511671 1073741824" returned: 0 in 0.622s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:28:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-44c25737-6e3a-4fc1-887b-eadc2e511671 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:28:16 devstack sudo[90108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-44c25737-6e3a-4fc1-887b-eadc2e511671 Nov 06 14:28:16 devstack sudo[90108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:28:16 devstack sudo[90108]: pam_unix(sudo:session): session closed for user root Nov 06 14:28:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-44c25737-6e3a-4fc1-887b-eadc2e511671" returned: 0 in 0.516s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:28:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:28:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:28:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaa96605-4538-4359-97fd-d8dc95e91d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44c25737-6e3a-4fc1-887b-eadc2e511671', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3cf5b3f-0e12-49b2-834e-60e6dc159a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:16 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Volume volume-44c25737-6e3a-4fc1-887b-eadc2e511671 (44c25737-6e3a-4fc1-887b-eadc2e511671): created successfully Nov 06 14:28:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3cf5b3f-0e12-49b2-834e-60e6dc159a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Flow 'volume_create_manager' (af4c586f-197b-46b5-a9f5-3352e0ba2cad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:28:16 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-13e96539-79d2-42b4-a3e4-1c6d97c8faf8 req-5146ef06-5c3c-4646-a7d1-61e0be591806 tempest-VolumesGetTestJSON-1611489292 None] Created volume successfully. Nov 06 14:28:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-a4a61d63-b801-4835-8ea7-7f7ae133f824 req-6f71ec44-a19d-4e72-8cd2-bb152598dd9d tempest-VolumesGetTestJSON-1611489292 None] Acquiring lock "cinder-44c25737-6e3a-4fc1-887b-eadc2e511671-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:28:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-a4a61d63-b801-4835-8ea7-7f7ae133f824 req-6f71ec44-a19d-4e72-8cd2-bb152598dd9d tempest-VolumesGetTestJSON-1611489292 None] Lock "cinder-44c25737-6e3a-4fc1-887b-eadc2e511671-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:28:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-a4a61d63-b801-4835-8ea7-7f7ae133f824 req-6f71ec44-a19d-4e72-8cd2-bb152598dd9d tempest-VolumesGetTestJSON-1611489292 None] Acquiring lock "cinder-quobyte-44c25737-6e3a-4fc1-887b-eadc2e511671" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:28:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-a4a61d63-b801-4835-8ea7-7f7ae133f824 req-6f71ec44-a19d-4e72-8cd2-bb152598dd9d tempest-VolumesGetTestJSON-1611489292 None] Lock "cinder-quobyte-44c25737-6e3a-4fc1-887b-eadc2e511671" acquired by "delete_volume" :: waited 0.031s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:28:18 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c1cb4c-8d29-439d-85c0-e89c477a0cbd]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:28:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-a4a61d63-b801-4835-8ea7-7f7ae133f824 req-6f71ec44-a19d-4e72-8cd2-bb152598dd9d tempest-VolumesGetTestJSON-1611489292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-44c25737-6e3a-4fc1-887b-eadc2e511671 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:28:18 devstack sudo[90112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-44c25737-6e3a-4fc1-887b-eadc2e511671 Nov 06 14:28:18 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:28:19 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root Nov 06 14:28:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-a4a61d63-b801-4835-8ea7-7f7ae133f824 req-6f71ec44-a19d-4e72-8cd2-bb152598dd9d tempest-VolumesGetTestJSON-1611489292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-44c25737-6e3a-4fc1-887b-eadc2e511671" returned: 0 in 0.568s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:28:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-a4a61d63-b801-4835-8ea7-7f7ae133f824 req-6f71ec44-a19d-4e72-8cd2-bb152598dd9d tempest-VolumesGetTestJSON-1611489292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-44c25737-6e3a-4fc1-887b-eadc2e511671 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:28:19 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-44c25737-6e3a-4fc1-887b-eadc2e511671 Nov 06 14:28:19 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:28:19 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Nov 06 14:28:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-a4a61d63-b801-4835-8ea7-7f7ae133f824 req-6f71ec44-a19d-4e72-8cd2-bb152598dd9d tempest-VolumesGetTestJSON-1611489292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-44c25737-6e3a-4fc1-887b-eadc2e511671" returned: 0 in 0.335s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:28:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-a4a61d63-b801-4835-8ea7-7f7ae133f824 req-6f71ec44-a19d-4e72-8cd2-bb152598dd9d tempest-VolumesGetTestJSON-1611489292 None] Lock "cinder-quobyte-44c25737-6e3a-4fc1-887b-eadc2e511671" released by "delete_volume" :: held 1.010s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:28:19 devstack cinder-volume[86854]: DEBUG cinder.quota [req-a4a61d63-b801-4835-8ea7-7f7ae133f824 req-6f71ec44-a19d-4e72-8cd2-bb152598dd9d tempest-VolumesGetTestJSON-1611489292 None] Created reservations ['6a13348e-70f1-4942-a9d8-04f70e18e7e1', '4d6ca436-d8df-4591-8c88-68a3b884cdaa', '54e2169b-b5d3-4f0c-9c00-7b50d8ad3398', 'e0c32343-86ee-4701-990b-80ca57818ef9'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:28:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-a4a61d63-b801-4835-8ea7-7f7ae133f824 req-6f71ec44-a19d-4e72-8cd2-bb152598dd9d tempest-VolumesGetTestJSON-1611489292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:28:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-a4a61d63-b801-4835-8ea7-7f7ae133f824 req-6f71ec44-a19d-4e72-8cd2-bb152598dd9d tempest-VolumesGetTestJSON-1611489292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:28:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [req-a4a61d63-b801-4835-8ea7-7f7ae133f824 req-6f71ec44-a19d-4e72-8cd2-bb152598dd9d tempest-VolumesGetTestJSON-1611489292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:28:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [req-a4a61d63-b801-4835-8ea7-7f7ae133f824 req-6f71ec44-a19d-4e72-8cd2-bb152598dd9d tempest-VolumesGetTestJSON-1611489292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:28:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-a4a61d63-b801-4835-8ea7-7f7ae133f824 req-6f71ec44-a19d-4e72-8cd2-bb152598dd9d tempest-VolumesGetTestJSON-1611489292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:28:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-a4a61d63-b801-4835-8ea7-7f7ae133f824 req-6f71ec44-a19d-4e72-8cd2-bb152598dd9d tempest-VolumesGetTestJSON-1611489292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:28:19 devstack sudo[90122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:28:19 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:28:20 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root Nov 06 14:28:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-a4a61d63-b801-4835-8ea7-7f7ae133f824 req-6f71ec44-a19d-4e72-8cd2-bb152598dd9d tempest-VolumesGetTestJSON-1611489292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.643s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:28:20 devstack cinder-volume[86854]: DEBUG cinder.manager [req-a4a61d63-b801-4835-8ea7-7f7ae133f824 req-6f71ec44-a19d-4e72-8cd2-bb152598dd9d tempest-VolumesGetTestJSON-1611489292 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:28:20 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-a4a61d63-b801-4835-8ea7-7f7ae133f824 req-6f71ec44-a19d-4e72-8cd2-bb152598dd9d tempest-VolumesGetTestJSON-1611489292 None] Deleted volume successfully. Nov 06 14:28:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-a4a61d63-b801-4835-8ea7-7f7ae133f824 req-6f71ec44-a19d-4e72-8cd2-bb152598dd9d tempest-VolumesGetTestJSON-1611489292 None] Lock "cinder-44c25737-6e3a-4fc1-887b-eadc2e511671-delete_volume" released by "delete_volume" :: held 2.094s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:28:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:28:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:28:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:28:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:28:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:28:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:28:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:28:23 devstack sudo[90130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:28:23 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:28:23 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root Nov 06 14:28:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.524s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:28:23 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:28:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager._thread_info {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:28:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread count: 8 {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 14:28:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread info: [<_MainThread(MainThread, started 130306900594816)>, , , , , , , ] {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 14:28:29 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=11,cinder:UPDATE=16,cinder:INSERT=4 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:28:30 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5b5a1d95-bdbf-4331-9b5c-53381121c17b tempest-BackendsCapabilitiesAdminTestsJSON-2108804364 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3879013061523, 'free_capacity_gb': 1773.3879013061523, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86854) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 06 14:28:30 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1cd65b38-c1eb-4551-a79b-85ffcaa0acc5 tempest-BackendsCapabilitiesAdminTestsJSON-2108804364 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3879013061523, 'free_capacity_gb': 1773.3879013061523, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86854) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 06 14:28:30 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=16,cinder:UPDATE=13,cinder:INSERT=2,cinder:DELETE=2 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:28:37 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:28:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Flow 'volume_create_manager' (4f1ed8ca-5dc9-45c8-ae73-b6273647a533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:28:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a16fd59-6add-41ca-bf73-ed4310f02799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a16fd59-6add-41ca-bf73-ed4310f02799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2108964832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c22d8f8f-6b1a-422a-b0a2-0821e57a4cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b383591e024fc0a33bce8139a2294e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:28:38Z,use_quota=True,user_id='cbe75a683e244729af5d627d7da7e991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e05bbc73-3460-48c4-bbab-d377f4d202e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e05bbc73-3460-48c4-bbab-d377f4d202e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c947ef26-fab1-4893-8c8f-1f0f33a45ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c947ef26-fab1-4893-8c8f-1f0f33a45ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c22d8f8f-6b1a-422a-b0a2-0821e57a4cf7', 'volume_name': 'volume-c22d8f8f-6b1a-422a-b0a2-0821e57a4cf7', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620a6f72-757a-4524-9008-0e2eeeb383e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620a6f72-757a-4524-9008-0e2eeeb383e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3bd9793-9a32-4859-8354-d56fdb570db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:38 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Volume c22d8f8f-6b1a-422a-b0a2-0821e57a4cf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c22d8f8f-6b1a-422a-b0a2-0821e57a4cf7', 'volume_size': 1} Nov 06 14:28:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:28:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:28:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2108964832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c22d8f8f-6b1a-422a-b0a2-0821e57a4cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b383591e024fc0a33bce8139a2294e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:28:38Z,use_quota=True,user_id='cbe75a683e244729af5d627d7da7e991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:28:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Creating volume c22d8f8f-6b1a-422a-b0a2-0821e57a4cf7 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:28:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:28:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:28:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:28:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:28:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:28:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:28:38 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:28:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c22d8f8f-6b1a-422a-b0a2-0821e57a4cf7 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:28:38 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c22d8f8f-6b1a-422a-b0a2-0821e57a4cf7 1073741824 Nov 06 14:28:38 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:28:38 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Nov 06 14:28:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c22d8f8f-6b1a-422a-b0a2-0821e57a4cf7 1073741824" returned: 0 in 0.562s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:28:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c22d8f8f-6b1a-422a-b0a2-0821e57a4cf7 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:28:38 devstack sudo[90292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c22d8f8f-6b1a-422a-b0a2-0821e57a4cf7 Nov 06 14:28:38 devstack sudo[90292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:28:39 devstack sudo[90292]: pam_unix(sudo:session): session closed for user root Nov 06 14:28:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c22d8f8f-6b1a-422a-b0a2-0821e57a4cf7" returned: 0 in 0.388s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:28:39 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:28:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:28:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3bd9793-9a32-4859-8354-d56fdb570db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c22d8f8f-6b1a-422a-b0a2-0821e57a4cf7', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e012b398-5356-4032-8985-3b180f2d25f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:39 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Volume volume-c22d8f8f-6b1a-422a-b0a2-0821e57a4cf7 (c22d8f8f-6b1a-422a-b0a2-0821e57a4cf7): created successfully Nov 06 14:28:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e012b398-5356-4032-8985-3b180f2d25f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Flow 'volume_create_manager' (4f1ed8ca-5dc9-45c8-ae73-b6273647a533) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:28:39 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-613d4cea-b37f-483d-95ae-b171ba8e7ce0 tempest-ServersNegativeTestJSON-2063509063 None] Created volume successfully. Nov 06 14:28:42 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:28:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Flow 'volume_create_manager' (a3e5653d-a759-4d66-8c49-5bd7935e1ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:28:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46b4c451-1519-4def-a006-73a40b9fced8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46b4c451-1519-4def-a006-73a40b9fced8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2045685394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd4c8f8-6587-4731-9348-2577bb8dd046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b383591e024fc0a33bce8139a2294e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:28:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:28:42Z,use_quota=True,user_id='cbe75a683e244729af5d627d7da7e991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfae3d7a-0903-48a3-a838-bab0cfa1c29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfae3d7a-0903-48a3-a838-bab0cfa1c29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d0ff4c-785a-48e3-9157-0181909077df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d0ff4c-785a-48e3-9157-0181909077df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcd4c8f8-6587-4731-9348-2577bb8dd046', 'volume_name': 'volume-bcd4c8f8-6587-4731-9348-2577bb8dd046', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36a0ef0b-6ba3-41e7-9dc1-099d063bc65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36a0ef0b-6ba3-41e7-9dc1-099d063bc65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9315d7a-4c73-4982-9fd8-e66757430827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:42 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Volume bcd4c8f8-6587-4731-9348-2577bb8dd046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcd4c8f8-6587-4731-9348-2577bb8dd046', 'volume_size': 1} Nov 06 14:28:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:28:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:28:42 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2045685394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd4c8f8-6587-4731-9348-2577bb8dd046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b383591e024fc0a33bce8139a2294e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:28:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:28:42Z,use_quota=True,user_id='cbe75a683e244729af5d627d7da7e991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:28:42 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Creating volume bcd4c8f8-6587-4731-9348-2577bb8dd046 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:28:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:28:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:28:42 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:28:42 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:28:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:28:42 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:28:42 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:28:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bcd4c8f8-6587-4731-9348-2577bb8dd046 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:28:42 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bcd4c8f8-6587-4731-9348-2577bb8dd046 1073741824 Nov 06 14:28:42 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:28:43 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Nov 06 14:28:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bcd4c8f8-6587-4731-9348-2577bb8dd046 1073741824" returned: 0 in 0.835s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:28:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bcd4c8f8-6587-4731-9348-2577bb8dd046 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:28:43 devstack sudo[90375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bcd4c8f8-6587-4731-9348-2577bb8dd046 Nov 06 14:28:43 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:28:44 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root Nov 06 14:28:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bcd4c8f8-6587-4731-9348-2577bb8dd046" returned: 0 in 0.469s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:28:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:28:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:28:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9315d7a-4c73-4982-9fd8-e66757430827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcd4c8f8-6587-4731-9348-2577bb8dd046', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8515a61f-cc99-4858-a089-82804572739a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:44 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Volume volume-bcd4c8f8-6587-4731-9348-2577bb8dd046 (bcd4c8f8-6587-4731-9348-2577bb8dd046): created successfully Nov 06 14:28:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8515a61f-cc99-4858-a089-82804572739a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Flow 'volume_create_manager' (a3e5653d-a759-4d66-8c49-5bd7935e1ba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:28:44 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-e3180b86-8744-4300-94b6-54a9d5113853 tempest-ServersNegativeTestJSON-2063509063 None] Created volume successfully. Nov 06 14:28:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4471d326-4f42-465d-8b34-d55c20d5d473 tempest-ServersNegativeTestJSON-2063509063 None] Acquiring lock "cinder-bcd4c8f8-6587-4731-9348-2577bb8dd046-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:28:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4471d326-4f42-465d-8b34-d55c20d5d473 tempest-ServersNegativeTestJSON-2063509063 None] Lock "cinder-bcd4c8f8-6587-4731-9348-2577bb8dd046-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:28:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4471d326-4f42-465d-8b34-d55c20d5d473 tempest-ServersNegativeTestJSON-2063509063 None] Acquiring lock "cinder-quobyte-bcd4c8f8-6587-4731-9348-2577bb8dd046" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:28:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4471d326-4f42-465d-8b34-d55c20d5d473 tempest-ServersNegativeTestJSON-2063509063 None] Lock "cinder-quobyte-bcd4c8f8-6587-4731-9348-2577bb8dd046" acquired by "delete_volume" :: waited 0.025s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:28:45 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[99be7ea1-b157-4405-9f0f-7cc808279a85]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:28:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4471d326-4f42-465d-8b34-d55c20d5d473 tempest-ServersNegativeTestJSON-2063509063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bcd4c8f8-6587-4731-9348-2577bb8dd046 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:28:45 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bcd4c8f8-6587-4731-9348-2577bb8dd046 Nov 06 14:28:45 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:28:46 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Nov 06 14:28:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4471d326-4f42-465d-8b34-d55c20d5d473 tempest-ServersNegativeTestJSON-2063509063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bcd4c8f8-6587-4731-9348-2577bb8dd046" returned: 0 in 0.634s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:28:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4471d326-4f42-465d-8b34-d55c20d5d473 tempest-ServersNegativeTestJSON-2063509063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bcd4c8f8-6587-4731-9348-2577bb8dd046 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:28:46 devstack sudo[90386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bcd4c8f8-6587-4731-9348-2577bb8dd046 Nov 06 14:28:46 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:28:46 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root Nov 06 14:28:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4471d326-4f42-465d-8b34-d55c20d5d473 tempest-ServersNegativeTestJSON-2063509063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bcd4c8f8-6587-4731-9348-2577bb8dd046" returned: 0 in 0.347s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:28:46 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4471d326-4f42-465d-8b34-d55c20d5d473 tempest-ServersNegativeTestJSON-2063509063 None] Lock "cinder-quobyte-bcd4c8f8-6587-4731-9348-2577bb8dd046" released by "delete_volume" :: held 1.060s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:28:46 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-4471d326-4f42-465d-8b34-d55c20d5d473 tempest-ServersNegativeTestJSON-2063509063 None] Created reservations ['a6e3bf17-62f7-4ce9-bbc7-b5ab02d50d65', 'cd49853c-3df8-4eed-ba0f-f0d339d6ebc7', 'd8303cbf-d61b-4a32-bb4e-d98145549f0d', 'f440e220-b9d6-4917-b5d1-1452b06b50d1'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:28:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4471d326-4f42-465d-8b34-d55c20d5d473 tempest-ServersNegativeTestJSON-2063509063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:28:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4471d326-4f42-465d-8b34-d55c20d5d473 tempest-ServersNegativeTestJSON-2063509063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:28:46 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4471d326-4f42-465d-8b34-d55c20d5d473 tempest-ServersNegativeTestJSON-2063509063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:28:46 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4471d326-4f42-465d-8b34-d55c20d5d473 tempest-ServersNegativeTestJSON-2063509063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:28:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4471d326-4f42-465d-8b34-d55c20d5d473 tempest-ServersNegativeTestJSON-2063509063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:28:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4471d326-4f42-465d-8b34-d55c20d5d473 tempest-ServersNegativeTestJSON-2063509063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:28:47 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:28:47 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:28:47 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Nov 06 14:28:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4471d326-4f42-465d-8b34-d55c20d5d473 tempest-ServersNegativeTestJSON-2063509063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.340s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:28:47 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-4471d326-4f42-465d-8b34-d55c20d5d473 tempest-ServersNegativeTestJSON-2063509063 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:28:47 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-4471d326-4f42-465d-8b34-d55c20d5d473 tempest-ServersNegativeTestJSON-2063509063 None] Deleted volume successfully. Nov 06 14:28:47 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4471d326-4f42-465d-8b34-d55c20d5d473 tempest-ServersNegativeTestJSON-2063509063 None] Lock "cinder-bcd4c8f8-6587-4731-9348-2577bb8dd046-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:28:47 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c96f21a7-d394-4bf1-b2e5-eed961802fee tempest-ServersNegativeTestJSON-2063509063 None] Acquiring lock "cinder-c22d8f8f-6b1a-422a-b0a2-0821e57a4cf7-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:28:48 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c96f21a7-d394-4bf1-b2e5-eed961802fee tempest-ServersNegativeTestJSON-2063509063 None] Lock "cinder-c22d8f8f-6b1a-422a-b0a2-0821e57a4cf7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:28:48 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c96f21a7-d394-4bf1-b2e5-eed961802fee tempest-ServersNegativeTestJSON-2063509063 None] Acquiring lock "cinder-quobyte-c22d8f8f-6b1a-422a-b0a2-0821e57a4cf7" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:28:48 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c96f21a7-d394-4bf1-b2e5-eed961802fee tempest-ServersNegativeTestJSON-2063509063 None] Lock "cinder-quobyte-c22d8f8f-6b1a-422a-b0a2-0821e57a4cf7" acquired by "delete_volume" :: waited 0.031s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:28:48 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[239b14a2-507e-4cb6-9f33-b2aea41843ef]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:28:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c96f21a7-d394-4bf1-b2e5-eed961802fee tempest-ServersNegativeTestJSON-2063509063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c22d8f8f-6b1a-422a-b0a2-0821e57a4cf7 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:28:48 devstack sudo[90392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c22d8f8f-6b1a-422a-b0a2-0821e57a4cf7 Nov 06 14:28:48 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:28:48 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root Nov 06 14:28:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c96f21a7-d394-4bf1-b2e5-eed961802fee tempest-ServersNegativeTestJSON-2063509063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c22d8f8f-6b1a-422a-b0a2-0821e57a4cf7" returned: 0 in 0.448s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:28:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c96f21a7-d394-4bf1-b2e5-eed961802fee tempest-ServersNegativeTestJSON-2063509063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c22d8f8f-6b1a-422a-b0a2-0821e57a4cf7 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:28:48 devstack sudo[90397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c22d8f8f-6b1a-422a-b0a2-0821e57a4cf7 Nov 06 14:28:48 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:28:48 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root Nov 06 14:28:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c96f21a7-d394-4bf1-b2e5-eed961802fee tempest-ServersNegativeTestJSON-2063509063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c22d8f8f-6b1a-422a-b0a2-0821e57a4cf7" returned: 0 in 0.354s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:28:48 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c96f21a7-d394-4bf1-b2e5-eed961802fee tempest-ServersNegativeTestJSON-2063509063 None] Lock "cinder-quobyte-c22d8f8f-6b1a-422a-b0a2-0821e57a4cf7" released by "delete_volume" :: held 0.861s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:28:49 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-c96f21a7-d394-4bf1-b2e5-eed961802fee tempest-ServersNegativeTestJSON-2063509063 None] Created reservations ['24e6d48b-4511-4973-bd1f-e3f151cb16dc', '1eec5884-8c93-42b6-aaae-94359ac21af8', 'ebf6d6c1-d213-45c0-be43-b32f7ae4ffb6', 'edfc2233-64a1-49ac-9dac-44b46dcdcf8c'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:28:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c96f21a7-d394-4bf1-b2e5-eed961802fee tempest-ServersNegativeTestJSON-2063509063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:28:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c96f21a7-d394-4bf1-b2e5-eed961802fee tempest-ServersNegativeTestJSON-2063509063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:28:49 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c96f21a7-d394-4bf1-b2e5-eed961802fee tempest-ServersNegativeTestJSON-2063509063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:28:49 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c96f21a7-d394-4bf1-b2e5-eed961802fee tempest-ServersNegativeTestJSON-2063509063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:28:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c96f21a7-d394-4bf1-b2e5-eed961802fee tempest-ServersNegativeTestJSON-2063509063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:28:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c96f21a7-d394-4bf1-b2e5-eed961802fee tempest-ServersNegativeTestJSON-2063509063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:28:49 devstack sudo[90401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:28:49 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:28:49 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root Nov 06 14:28:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c96f21a7-d394-4bf1-b2e5-eed961802fee tempest-ServersNegativeTestJSON-2063509063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.585s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:28:49 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-c96f21a7-d394-4bf1-b2e5-eed961802fee tempest-ServersNegativeTestJSON-2063509063 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:28:49 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-c96f21a7-d394-4bf1-b2e5-eed961802fee tempest-ServersNegativeTestJSON-2063509063 None] Deleted volume successfully. Nov 06 14:28:49 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c96f21a7-d394-4bf1-b2e5-eed961802fee tempest-ServersNegativeTestJSON-2063509063 None] Lock "cinder-c22d8f8f-6b1a-422a-b0a2-0821e57a4cf7-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:28:50 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:28:50 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Flow 'volume_create_manager' (d618088f-776c-4898-84ca-6a921f1e9e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:28:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f0f5f3f-864f-4ca3-a754-b2cb353dbf58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f0f5f3f-864f-4ca3-a754-b2cb353dbf58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-562115511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff66001-aadc-47a6-bea1-133f0178336f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26b5ee4fc4145b7abdca9b538b0172f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:28:51Z,use_quota=True,user_id='889766b9e0ff40029fa658f62520dc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9a23fd-0277-42f6-b762-56a1fb929ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9a23fd-0277-42f6-b762-56a1fb929ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc594d6c-60b0-4591-8266-1004dc98969a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc594d6c-60b0-4591-8266-1004dc98969a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ff66001-aadc-47a6-bea1-133f0178336f', 'volume_name': 'volume-5ff66001-aadc-47a6-bea1-133f0178336f', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce0bd69-6444-4312-b6be-85f3d51ca2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce0bd69-6444-4312-b6be-85f3d51ca2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a1df7af-c707-4576-9769-885bb32a95aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:51 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Volume 5ff66001-aadc-47a6-bea1-133f0178336f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ff66001-aadc-47a6-bea1-133f0178336f', 'volume_size': 1} Nov 06 14:28:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:28:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:28:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-562115511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff66001-aadc-47a6-bea1-133f0178336f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26b5ee4fc4145b7abdca9b538b0172f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:28:51Z,use_quota=True,user_id='889766b9e0ff40029fa658f62520dc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:28:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Creating volume 5ff66001-aadc-47a6-bea1-133f0178336f {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:28:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:28:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:28:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:28:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:28:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:28:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:28:51 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:28:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5ff66001-aadc-47a6-bea1-133f0178336f 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:28:51 devstack sudo[90427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5ff66001-aadc-47a6-bea1-133f0178336f 1073741824 Nov 06 14:28:51 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:28:51 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root Nov 06 14:28:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5ff66001-aadc-47a6-bea1-133f0178336f 1073741824" returned: 0 in 0.816s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:28:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5ff66001-aadc-47a6-bea1-133f0178336f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:28:52 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5ff66001-aadc-47a6-bea1-133f0178336f Nov 06 14:28:52 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:28:52 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Nov 06 14:28:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5ff66001-aadc-47a6-bea1-133f0178336f" returned: 0 in 0.290s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:28:52 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:28:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:28:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a1df7af-c707-4576-9769-885bb32a95aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ff66001-aadc-47a6-bea1-133f0178336f', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0a3c71-c2de-4c11-b355-3e943deff42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:52 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Volume volume-5ff66001-aadc-47a6-bea1-133f0178336f (5ff66001-aadc-47a6-bea1-133f0178336f): created successfully Nov 06 14:28:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0a3c71-c2de-4c11-b355-3e943deff42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Flow 'volume_create_manager' (d618088f-776c-4898-84ca-6a921f1e9e8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:28:52 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-a0e96cf8-11da-4811-9128-a174d87dd4b4 tempest-VolumeQuotasAdminTestJSON-815568411 None] Created volume successfully. Nov 06 14:28:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7bed2e6d-ad9d-41e1-80be-14b91e914e49 tempest-VolumeQuotasAdminTestJSON-815568411 None] Acquiring lock "cinder-5ff66001-aadc-47a6-bea1-133f0178336f-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:28:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7bed2e6d-ad9d-41e1-80be-14b91e914e49 tempest-VolumeQuotasAdminTestJSON-815568411 None] Lock "cinder-5ff66001-aadc-47a6-bea1-133f0178336f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:28:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7bed2e6d-ad9d-41e1-80be-14b91e914e49 tempest-VolumeQuotasAdminTestJSON-815568411 None] Acquiring lock "cinder-quobyte-5ff66001-aadc-47a6-bea1-133f0178336f" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:28:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7bed2e6d-ad9d-41e1-80be-14b91e914e49 tempest-VolumeQuotasAdminTestJSON-815568411 None] Lock "cinder-quobyte-5ff66001-aadc-47a6-bea1-133f0178336f" acquired by "delete_volume" :: waited 0.032s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:28:53 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[741bb528-dc5d-40bc-b420-48cb6f281162]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:28:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7bed2e6d-ad9d-41e1-80be-14b91e914e49 tempest-VolumeQuotasAdminTestJSON-815568411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5ff66001-aadc-47a6-bea1-133f0178336f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:28:53 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5ff66001-aadc-47a6-bea1-133f0178336f Nov 06 14:28:53 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:28:53 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Nov 06 14:28:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7bed2e6d-ad9d-41e1-80be-14b91e914e49 tempest-VolumeQuotasAdminTestJSON-815568411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5ff66001-aadc-47a6-bea1-133f0178336f" returned: 0 in 0.475s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:28:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7bed2e6d-ad9d-41e1-80be-14b91e914e49 tempest-VolumeQuotasAdminTestJSON-815568411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5ff66001-aadc-47a6-bea1-133f0178336f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:28:53 devstack sudo[90465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5ff66001-aadc-47a6-bea1-133f0178336f Nov 06 14:28:53 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:28:54 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root Nov 06 14:28:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7bed2e6d-ad9d-41e1-80be-14b91e914e49 tempest-VolumeQuotasAdminTestJSON-815568411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5ff66001-aadc-47a6-bea1-133f0178336f" returned: 0 in 0.286s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:28:54 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7bed2e6d-ad9d-41e1-80be-14b91e914e49 tempest-VolumeQuotasAdminTestJSON-815568411 None] Lock "cinder-quobyte-5ff66001-aadc-47a6-bea1-133f0178336f" released by "delete_volume" :: held 0.809s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:28:54 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-7bed2e6d-ad9d-41e1-80be-14b91e914e49 tempest-VolumeQuotasAdminTestJSON-815568411 None] Created reservations ['f34439b1-afd8-4c7d-a962-502e2babbe8b', 'f762b369-70b9-48d1-b91a-91d92e3119f2', 'ae6cfb3c-69ad-4fef-a3de-ca87458e2345', '30462162-8885-42fa-b611-402ea063dfc3'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:28:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7bed2e6d-ad9d-41e1-80be-14b91e914e49 tempest-VolumeQuotasAdminTestJSON-815568411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:28:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7bed2e6d-ad9d-41e1-80be-14b91e914e49 tempest-VolumeQuotasAdminTestJSON-815568411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:28:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7bed2e6d-ad9d-41e1-80be-14b91e914e49 tempest-VolumeQuotasAdminTestJSON-815568411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:28:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7bed2e6d-ad9d-41e1-80be-14b91e914e49 tempest-VolumeQuotasAdminTestJSON-815568411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:28:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7bed2e6d-ad9d-41e1-80be-14b91e914e49 tempest-VolumeQuotasAdminTestJSON-815568411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:28:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7bed2e6d-ad9d-41e1-80be-14b91e914e49 tempest-VolumeQuotasAdminTestJSON-815568411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:28:54 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:28:54 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:28:54 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Nov 06 14:28:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7bed2e6d-ad9d-41e1-80be-14b91e914e49 tempest-VolumeQuotasAdminTestJSON-815568411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.339s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:28:54 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-7bed2e6d-ad9d-41e1-80be-14b91e914e49 tempest-VolumeQuotasAdminTestJSON-815568411 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:28:54 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-7bed2e6d-ad9d-41e1-80be-14b91e914e49 tempest-VolumeQuotasAdminTestJSON-815568411 None] Deleted volume successfully. Nov 06 14:28:54 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7bed2e6d-ad9d-41e1-80be-14b91e914e49 tempest-VolumeQuotasAdminTestJSON-815568411 None] Lock "cinder-5ff66001-aadc-47a6-bea1-133f0178336f-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:28:55 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:28:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Flow 'volume_create_manager' (fc60b8ba-1dfa-4baa-8520-e9ce22984376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:28:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fbe2b35-bc7e-4892-b7ac-ee0ea2514460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fbe2b35-bc7e-4892-b7ac-ee0ea2514460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1675072729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aec62774-a0f1-4e20-8ed8-fea72e2b4391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26b5ee4fc4145b7abdca9b538b0172f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:28:55Z,use_quota=True,user_id='889766b9e0ff40029fa658f62520dc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3f9b85-da0f-4cc5-9359-62d9dbdccf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3f9b85-da0f-4cc5-9359-62d9dbdccf6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229e5e1a-c459-4da9-99a0-3a4bb7f86ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229e5e1a-c459-4da9-99a0-3a4bb7f86ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aec62774-a0f1-4e20-8ed8-fea72e2b4391', 'volume_name': 'volume-aec62774-a0f1-4e20-8ed8-fea72e2b4391', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3b4095f-89c2-4ecf-b1be-3e3e28254e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3b4095f-89c2-4ecf-b1be-3e3e28254e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d80d141d-3386-41ec-af29-f580e8272586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:55 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Volume aec62774-a0f1-4e20-8ed8-fea72e2b4391: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aec62774-a0f1-4e20-8ed8-fea72e2b4391', 'volume_size': 1} Nov 06 14:28:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:28:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:28:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1675072729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aec62774-a0f1-4e20-8ed8-fea72e2b4391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26b5ee4fc4145b7abdca9b538b0172f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:28:55Z,use_quota=True,user_id='889766b9e0ff40029fa658f62520dc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:28:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Creating volume aec62774-a0f1-4e20-8ed8-fea72e2b4391 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:28:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:28:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:28:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:28:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:28:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:28:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:28:55 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:28:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aec62774-a0f1-4e20-8ed8-fea72e2b4391 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:28:55 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aec62774-a0f1-4e20-8ed8-fea72e2b4391 1073741824 Nov 06 14:28:55 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:28:55 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Nov 06 14:28:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aec62774-a0f1-4e20-8ed8-fea72e2b4391 1073741824" returned: 0 in 0.483s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:28:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aec62774-a0f1-4e20-8ed8-fea72e2b4391 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:28:55 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aec62774-a0f1-4e20-8ed8-fea72e2b4391 Nov 06 14:28:55 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:28:56 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Nov 06 14:28:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aec62774-a0f1-4e20-8ed8-fea72e2b4391" returned: 0 in 0.266s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:28:56 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:28:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:28:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d80d141d-3386-41ec-af29-f580e8272586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aec62774-a0f1-4e20-8ed8-fea72e2b4391', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7f65554-79c9-422f-94d6-48b2abeb8409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:28:56 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Volume volume-aec62774-a0f1-4e20-8ed8-fea72e2b4391 (aec62774-a0f1-4e20-8ed8-fea72e2b4391): created successfully Nov 06 14:28:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7f65554-79c9-422f-94d6-48b2abeb8409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:28:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Flow 'volume_create_manager' (fc60b8ba-1dfa-4baa-8520-e9ce22984376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:28:56 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-e05e65b2-5698-4aae-9ce0-89a2a8961b81 tempest-VolumeQuotasAdminTestJSON-815568411 None] Created volume successfully. Nov 06 14:28:58 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-ddfd0bd0-9c0f-4832-baa3-b569d1911355 tempest-VolumeQuotasAdminTestJSON-231782165 None] Transfer volume completed successfully. Nov 06 14:28:58 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6fd12b87-683a-488d-82ab-c62f68a4b092 tempest-VolumeQuotasAdminTestJSON-636323933 None] Acquiring lock "cinder-aec62774-a0f1-4e20-8ed8-fea72e2b4391-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:28:58 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6fd12b87-683a-488d-82ab-c62f68a4b092 tempest-VolumeQuotasAdminTestJSON-636323933 None] Lock "cinder-aec62774-a0f1-4e20-8ed8-fea72e2b4391-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:28:58 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6fd12b87-683a-488d-82ab-c62f68a4b092 tempest-VolumeQuotasAdminTestJSON-636323933 None] Acquiring lock "cinder-quobyte-aec62774-a0f1-4e20-8ed8-fea72e2b4391" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:28:58 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6fd12b87-683a-488d-82ab-c62f68a4b092 tempest-VolumeQuotasAdminTestJSON-636323933 None] Lock "cinder-quobyte-aec62774-a0f1-4e20-8ed8-fea72e2b4391" acquired by "delete_volume" :: waited 0.019s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:28:58 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a8a296-1393-4829-b5e6-a969b295f909]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:28:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6fd12b87-683a-488d-82ab-c62f68a4b092 tempest-VolumeQuotasAdminTestJSON-636323933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aec62774-a0f1-4e20-8ed8-fea72e2b4391 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:28:59 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aec62774-a0f1-4e20-8ed8-fea72e2b4391 Nov 06 14:28:59 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:28:59 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Nov 06 14:28:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6fd12b87-683a-488d-82ab-c62f68a4b092 tempest-VolumeQuotasAdminTestJSON-636323933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aec62774-a0f1-4e20-8ed8-fea72e2b4391" returned: 0 in 0.377s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:28:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6fd12b87-683a-488d-82ab-c62f68a4b092 tempest-VolumeQuotasAdminTestJSON-636323933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aec62774-a0f1-4e20-8ed8-fea72e2b4391 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:28:59 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aec62774-a0f1-4e20-8ed8-fea72e2b4391 Nov 06 14:28:59 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:28:59 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Nov 06 14:28:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6fd12b87-683a-488d-82ab-c62f68a4b092 tempest-VolumeQuotasAdminTestJSON-636323933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aec62774-a0f1-4e20-8ed8-fea72e2b4391" returned: 0 in 0.258s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:28:59 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6fd12b87-683a-488d-82ab-c62f68a4b092 tempest-VolumeQuotasAdminTestJSON-636323933 None] Lock "cinder-quobyte-aec62774-a0f1-4e20-8ed8-fea72e2b4391" released by "delete_volume" :: held 0.703s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:28:59 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-6fd12b87-683a-488d-82ab-c62f68a4b092 tempest-VolumeQuotasAdminTestJSON-636323933 None] Created reservations ['0e9c35f9-bfb9-4696-83c0-6f8a7ee62c4b', '65bff0d4-3fa9-4731-a7c3-7086c55498e8', '5015baa2-1d01-4a5f-bf43-8c82f5a34a5a', 'c7c0f34c-cf2c-480d-9903-a953431dc84e'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:28:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6fd12b87-683a-488d-82ab-c62f68a4b092 tempest-VolumeQuotasAdminTestJSON-636323933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:28:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6fd12b87-683a-488d-82ab-c62f68a4b092 tempest-VolumeQuotasAdminTestJSON-636323933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:28:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6fd12b87-683a-488d-82ab-c62f68a4b092 tempest-VolumeQuotasAdminTestJSON-636323933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:28:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6fd12b87-683a-488d-82ab-c62f68a4b092 tempest-VolumeQuotasAdminTestJSON-636323933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:28:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6fd12b87-683a-488d-82ab-c62f68a4b092 tempest-VolumeQuotasAdminTestJSON-636323933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:28:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6fd12b87-683a-488d-82ab-c62f68a4b092 tempest-VolumeQuotasAdminTestJSON-636323933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:28:59 devstack sudo[90495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:28:59 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:28:59 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root Nov 06 14:28:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6fd12b87-683a-488d-82ab-c62f68a4b092 tempest-VolumeQuotasAdminTestJSON-636323933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.281s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:28:59 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-6fd12b87-683a-488d-82ab-c62f68a4b092 tempest-VolumeQuotasAdminTestJSON-636323933 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:28:59 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-6fd12b87-683a-488d-82ab-c62f68a4b092 tempest-VolumeQuotasAdminTestJSON-636323933 None] Deleted volume successfully. Nov 06 14:29:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6fd12b87-683a-488d-82ab-c62f68a4b092 tempest-VolumeQuotasAdminTestJSON-636323933 None] Lock "cinder-aec62774-a0f1-4e20-8ed8-fea72e2b4391-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:29:08 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:29:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Flow 'volume_create_manager' (8740817d-37f2-477d-9041-3a7f51eb7974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:29:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d054ef46-503e-4823-8925-496ee4c58514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d054ef46-503e-4823-8925-496ee4c58514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1991249273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e363f1a1-7198-4c78-bc8a-e8a8feb1815d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d96214a54de244d890f6dd463e905c69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:29:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:29:09Z,use_quota=True,user_id='f7b945d7977b467c8766928a2f6f95ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11a4187-b693-4777-8001-17a2f09c8eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11a4187-b693-4777-8001-17a2f09c8eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a98e276-049e-4b96-a576-1c492be161d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a98e276-049e-4b96-a576-1c492be161d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e363f1a1-7198-4c78-bc8a-e8a8feb1815d', 'volume_name': 'volume-e363f1a1-7198-4c78-bc8a-e8a8feb1815d', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4839fc1a-02bf-43db-8992-6e5bdabe792f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4839fc1a-02bf-43db-8992-6e5bdabe792f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb6d103-fe61-45d3-b77d-8d9e62b11c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:09 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Volume e363f1a1-7198-4c78-bc8a-e8a8feb1815d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e363f1a1-7198-4c78-bc8a-e8a8feb1815d', 'volume_size': 1} Nov 06 14:29:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:29:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:29:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1991249273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e363f1a1-7198-4c78-bc8a-e8a8feb1815d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d96214a54de244d890f6dd463e905c69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:29:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:29:09Z,use_quota=True,user_id='f7b945d7977b467c8766928a2f6f95ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:29:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Creating volume e363f1a1-7198-4c78-bc8a-e8a8feb1815d {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:29:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:29:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:29:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:29:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:29:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:29:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:29:09 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:29:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e363f1a1-7198-4c78-bc8a-e8a8feb1815d 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:09 devstack sudo[90552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e363f1a1-7198-4c78-bc8a-e8a8feb1815d 1073741824 Nov 06 14:29:09 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:09 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e363f1a1-7198-4c78-bc8a-e8a8feb1815d 1073741824" returned: 0 in 0.699s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e363f1a1-7198-4c78-bc8a-e8a8feb1815d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:09 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e363f1a1-7198-4c78-bc8a-e8a8feb1815d Nov 06 14:29:09 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:10 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e363f1a1-7198-4c78-bc8a-e8a8feb1815d" returned: 0 in 0.276s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:10 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:29:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:29:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb6d103-fe61-45d3-b77d-8d9e62b11c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e363f1a1-7198-4c78-bc8a-e8a8feb1815d', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e8a07f1-5879-44f2-9bec-f247f232ccff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:10 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Volume volume-e363f1a1-7198-4c78-bc8a-e8a8feb1815d (e363f1a1-7198-4c78-bc8a-e8a8feb1815d): created successfully Nov 06 14:29:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e8a07f1-5879-44f2-9bec-f247f232ccff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Flow 'volume_create_manager' (8740817d-37f2-477d-9041-3a7f51eb7974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:29:10 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-72577f0a-97d1-4202-b351-5a148fdce711 tempest-ServerActionsTestOtherA-1610590813 None] Created volume successfully. Nov 06 14:29:17 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:29:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Flow 'volume_create_manager' (fe0af9b0-39f3-4791-bd17-cd2dffff7d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:29:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5c143d-bd26-4324-a2cf-62e571a12f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5c143d-bd26-4324-a2cf-62e571a12f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-134861283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3a42fde-0430-47e4-ba17-ee1e5a855f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700951bd81cd4fa6ab893ead67d0c28a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:29:17Z,use_quota=True,user_id='2b6870fd6b91466a83aa99c6b12a6f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(210bf1d5-995f-4ec9-9aca-10bea81f43b9),volume_type_id=210bf1d5-995f-4ec9-9aca-10bea81f43b9)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46bd953-73b9-46c7-8c69-018c16f6362a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46bd953-73b9-46c7-8c69-018c16f6362a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232a4127-5936-4b4e-bc29-29460729b607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232a4127-5936-4b4e-bc29-29460729b607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3a42fde-0430-47e4-ba17-ee1e5a855f43', 'volume_name': 'volume-a3a42fde-0430-47e4-ba17-ee1e5a855f43', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffed8049-56cd-4faf-bca3-4b6be345c758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffed8049-56cd-4faf-bca3-4b6be345c758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51597c18-6a6a-484f-bbb6-0144fc7bfa2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:17 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Volume a3a42fde-0430-47e4-ba17-ee1e5a855f43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3a42fde-0430-47e4-ba17-ee1e5a855f43', 'volume_size': 1} Nov 06 14:29:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:29:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:29:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-134861283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3a42fde-0430-47e4-ba17-ee1e5a855f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700951bd81cd4fa6ab893ead67d0c28a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:29:17Z,use_quota=True,user_id='2b6870fd6b91466a83aa99c6b12a6f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(210bf1d5-995f-4ec9-9aca-10bea81f43b9),volume_type_id=210bf1d5-995f-4ec9-9aca-10bea81f43b9)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:29:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Creating volume a3a42fde-0430-47e4-ba17-ee1e5a855f43 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:29:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:29:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:29:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:29:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:29:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:29:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:29:17 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:29:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a3a42fde-0430-47e4-ba17-ee1e5a855f43 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:17 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a3a42fde-0430-47e4-ba17-ee1e5a855f43 1073741824 Nov 06 14:29:17 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:18 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a3a42fde-0430-47e4-ba17-ee1e5a855f43 1073741824" returned: 0 in 0.723s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a3a42fde-0430-47e4-ba17-ee1e5a855f43 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:18 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a3a42fde-0430-47e4-ba17-ee1e5a855f43 Nov 06 14:29:18 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:18 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a3a42fde-0430-47e4-ba17-ee1e5a855f43" returned: 0 in 0.301s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:18 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:29:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:29:18 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51597c18-6a6a-484f-bbb6-0144fc7bfa2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3a42fde-0430-47e4-ba17-ee1e5a855f43', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:18 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8513331-7a6a-46b0-a981-103fa2f2f322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:18 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Volume volume-a3a42fde-0430-47e4-ba17-ee1e5a855f43 (a3a42fde-0430-47e4-ba17-ee1e5a855f43): created successfully Nov 06 14:29:18 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8513331-7a6a-46b0-a981-103fa2f2f322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:18 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Flow 'volume_create_manager' (fe0af9b0-39f3-4791-bd17-cd2dffff7d63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:29:18 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-f2572ec2-791e-4566-bf97-b4cb11ad3af2 tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Created volume successfully. Nov 06 14:29:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-146e0b63-4abb-48e8-8a30-59173474cedc tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:29:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-146e0b63-4abb-48e8-8a30-59173474cedc tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:29:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-146e0b63-4abb-48e8-8a30-59173474cedc tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:29:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-146e0b63-4abb-48e8-8a30-59173474cedc tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:29:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-146e0b63-4abb-48e8-8a30-59173474cedc tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:29:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-146e0b63-4abb-48e8-8a30-59173474cedc tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:20 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:29:20 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:21 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-146e0b63-4abb-48e8-8a30-59173474cedc tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.506s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:21 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-146e0b63-4abb-48e8-8a30-59173474cedc tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:29:21 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-146e0b63-4abb-48e8-8a30-59173474cedc tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Retype volume completed successfully. Nov 06 14:29:21 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:29:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Flow 'volume_create_manager' (961865a6-c330-43e0-b0b6-3d32436f3e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:29:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a02e101-ad90-4068-a6b8-1f1b55c34e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a02e101-ad90-4068-a6b8-1f1b55c34e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1190845203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b97284-5b97-4c88-99b7-f995899a9881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a8d4bc69db4494a801ea943294b13df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:29:22Z,use_quota=True,user_id='c0e3159397104e83a938aeb4460f4ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d872ad36-eb6d-4523-a8da-1951c051f8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d872ad36-eb6d-4523-a8da-1951c051f8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461e3aaf-534f-4c6e-a713-5e772bb446c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461e3aaf-534f-4c6e-a713-5e772bb446c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32b97284-5b97-4c88-99b7-f995899a9881', 'volume_name': 'volume-32b97284-5b97-4c88-99b7-f995899a9881', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f47649c7-e79f-45cc-a6ab-6f86c240b869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f47649c7-e79f-45cc-a6ab-6f86c240b869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (291dad35-f627-4b13-9eb4-6db33a418b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:21 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Volume 32b97284-5b97-4c88-99b7-f995899a9881: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32b97284-5b97-4c88-99b7-f995899a9881', 'volume_size': 1} Nov 06 14:29:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:29:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:29:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1190845203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b97284-5b97-4c88-99b7-f995899a9881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a8d4bc69db4494a801ea943294b13df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:29:22Z,use_quota=True,user_id='c0e3159397104e83a938aeb4460f4ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:29:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Creating volume 32b97284-5b97-4c88-99b7-f995899a9881 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:29:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:29:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:29:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:29:22 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:29:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:29:22 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:29:22 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:29:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:22 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881 1073741824 Nov 06 14:29:22 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-140b536c-339c-4ee2-95e0-c4f83a58f26d tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Acquiring lock "cinder-a3a42fde-0430-47e4-ba17-ee1e5a855f43-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:29:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-140b536c-339c-4ee2-95e0-c4f83a58f26d tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Lock "cinder-a3a42fde-0430-47e4-ba17-ee1e5a855f43-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:29:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-140b536c-339c-4ee2-95e0-c4f83a58f26d tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Acquiring lock "cinder-quobyte-a3a42fde-0430-47e4-ba17-ee1e5a855f43" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:29:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-140b536c-339c-4ee2-95e0-c4f83a58f26d tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Lock "cinder-quobyte-a3a42fde-0430-47e4-ba17-ee1e5a855f43" acquired by "delete_volume" :: waited 0.023s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:29:22 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c5687b-ae1d-4b2e-8cbc-8710e28bd0f1]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:29:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-140b536c-339c-4ee2-95e0-c4f83a58f26d tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a3a42fde-0430-47e4-ba17-ee1e5a855f43 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:22 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881 1073741824" returned: 0 in 0.726s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:22 devstack sudo[90670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a3a42fde-0430-47e4-ba17-ee1e5a855f43 Nov 06 14:29:22 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:22 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881 Nov 06 14:29:22 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:29:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:29:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:29:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:29:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:29:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:29:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:23 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:29:23 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:23 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881" returned: 0 in 0.391s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:29:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:29:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (291dad35-f627-4b13-9eb4-6db33a418b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32b97284-5b97-4c88-99b7-f995899a9881', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e48dfb-6367-4505-98b7-869e9e1760b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:23 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Volume volume-32b97284-5b97-4c88-99b7-f995899a9881 (32b97284-5b97-4c88-99b7-f995899a9881): created successfully Nov 06 14:29:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e48dfb-6367-4505-98b7-869e9e1760b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Flow 'volume_create_manager' (961865a6-c330-43e0-b0b6-3d32436f3e30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:29:23 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-35762e0e-5d5b-4734-8109-2440c8f27cd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Created volume successfully. Nov 06 14:29:23 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-140b536c-339c-4ee2-95e0-c4f83a58f26d tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a3a42fde-0430-47e4-ba17-ee1e5a855f43" returned: 0 in 0.641s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-140b536c-339c-4ee2-95e0-c4f83a58f26d tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a3a42fde-0430-47e4-ba17-ee1e5a855f43 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:23 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a3a42fde-0430-47e4-ba17-ee1e5a855f43 Nov 06 14:29:23 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:23 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.626s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:23 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:29:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager._thread_info {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:29:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread count: 8 {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 14:29:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread info: [<_MainThread(MainThread, started 130306900594816)>, , , , , , , ] {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 14:29:23 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-140b536c-339c-4ee2-95e0-c4f83a58f26d tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a3a42fde-0430-47e4-ba17-ee1e5a855f43" returned: 0 in 0.605s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-140b536c-339c-4ee2-95e0-c4f83a58f26d tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Lock "cinder-quobyte-a3a42fde-0430-47e4-ba17-ee1e5a855f43" released by "delete_volume" :: held 1.330s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:29:24 devstack cinder-volume[86854]: WARNING cinder.quota [None req-140b536c-339c-4ee2-95e0-c4f83a58f26d tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:29:24 devstack cinder-volume[86854]: WARNING cinder.quota [None req-140b536c-339c-4ee2-95e0-c4f83a58f26d tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:29:24 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-140b536c-339c-4ee2-95e0-c4f83a58f26d tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Created reservations ['55e2288a-edc3-41cf-89d1-6cdbe5ff31e3', '25fd501d-215b-49ba-8966-5212c5d43e2d', 'b2cd7334-2dd0-4981-878b-f633d6d18a5e', '31fbc4fe-5fd0-4408-813e-92d9e906260e'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:29:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-20999165-df69-48f1-b6d6-afbfbcba6510 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:29:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-20999165-df69-48f1-b6d6-afbfbcba6510 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:29:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-20999165-df69-48f1-b6d6-afbfbcba6510 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Creating offline snapshot d4c398f8-811c-47db-ba51-89cc942ec335 of volume 32b97284-5b97-4c88-99b7-f995899a9881 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:29:24 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[4314a93b-d8bb-4053-b524-088a32d1cd40]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:29:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-20999165-df69-48f1-b6d6-afbfbcba6510 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-140b536c-339c-4ee2-95e0-c4f83a58f26d tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:29:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-140b536c-339c-4ee2-95e0-c4f83a58f26d tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:29:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-140b536c-339c-4ee2-95e0-c4f83a58f26d tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:29:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-140b536c-339c-4ee2-95e0-c4f83a58f26d tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:29:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-140b536c-339c-4ee2-95e0-c4f83a58f26d tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:29:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-140b536c-339c-4ee2-95e0-c4f83a58f26d tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:24 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:29:24 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:24 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881 Nov 06 14:29:24 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:24 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-140b536c-339c-4ee2-95e0-c4f83a58f26d tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.574s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:24 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-140b536c-339c-4ee2-95e0-c4f83a58f26d tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:29:24 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-140b536c-339c-4ee2-95e0-c4f83a58f26d tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Deleted volume successfully. Nov 06 14:29:24 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-140b536c-339c-4ee2-95e0-c4f83a58f26d tempest-VolumeRetypeWithoutMigrationTest-2104551064 None] Lock "cinder-a3a42fde-0430-47e4-ba17-ee1e5a855f43-delete_volume" released by "delete_volume" :: held 2.463s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:29:25 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-20999165-df69-48f1-b6d6-afbfbcba6510 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881" returned: 0 in 1.129s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-20999165-df69-48f1-b6d6-afbfbcba6510 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881.d4c398f8-811c-47db-ba51-89cc942ec335 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:25 devstack sudo[90742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881.d4c398f8-811c-47db-ba51-89cc942ec335 1G Nov 06 14:29:25 devstack sudo[90742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:26 devstack sudo[90742]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-20999165-df69-48f1-b6d6-afbfbcba6510 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881.d4c398f8-811c-47db-ba51-89cc942ec335 1G" returned: 0 in 1.259s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-20999165-df69-48f1-b6d6-afbfbcba6510 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b97284-5b97-4c88-99b7-f995899a9881 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881.d4c398f8-811c-47db-ba51-89cc942ec335 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:26 devstack sudo[90770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b97284-5b97-4c88-99b7-f995899a9881 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881.d4c398f8-811c-47db-ba51-89cc942ec335 Nov 06 14:29:26 devstack sudo[90770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:27 devstack sudo[90770]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-20999165-df69-48f1-b6d6-afbfbcba6510 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b97284-5b97-4c88-99b7-f995899a9881 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881.d4c398f8-811c-47db-ba51-89cc942ec335" returned: 0 in 0.604s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:27 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-20999165-df69-48f1-b6d6-afbfbcba6510 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881.d4c398f8-811c-47db-ba51-89cc942ec335 is being set with open permissions: ugo+rw Nov 06 14:29:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-20999165-df69-48f1-b6d6-afbfbcba6510 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881.d4c398f8-811c-47db-ba51-89cc942ec335 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:27 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881.d4c398f8-811c-47db-ba51-89cc942ec335 Nov 06 14:29:27 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:27 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-20999165-df69-48f1-b6d6-afbfbcba6510 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881.d4c398f8-811c-47db-ba51-89cc942ec335" returned: 0 in 0.573s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-20999165-df69-48f1-b6d6-afbfbcba6510 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:27 devstack sudo[90784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881.info Nov 06 14:29:27 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:28 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-20999165-df69-48f1-b6d6-afbfbcba6510 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881.info" returned: 0 in 0.450s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:28 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-20999165-df69-48f1-b6d6-afbfbcba6510 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881.info is being set with open permissions: ugo+rw Nov 06 14:29:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-20999165-df69-48f1-b6d6-afbfbcba6510 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:28 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881.info Nov 06 14:29:28 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:28 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-20999165-df69-48f1-b6d6-afbfbcba6510 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881.info" returned: 0 in 0.338s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-20999165-df69-48f1-b6d6-afbfbcba6510 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.598s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:29:28 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-20999165-df69-48f1-b6d6-afbfbcba6510 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Create snapshot completed successfully Nov 06 14:29:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8cf1ce13-7c78-4112-b595-c4037b42e56c tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Acquiring lock "cinder-d4c398f8-811c-47db-ba51-89cc942ec335-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:29:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8cf1ce13-7c78-4112-b595-c4037b42e56c tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Lock "cinder-d4c398f8-811c-47db-ba51-89cc942ec335-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:29:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8cf1ce13-7c78-4112-b595-c4037b42e56c tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Acquiring lock "cinder-quobyte-32b97284-5b97-4c88-99b7-f995899a9881" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:29:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8cf1ce13-7c78-4112-b595-c4037b42e56c tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Lock "cinder-quobyte-32b97284-5b97-4c88-99b7-f995899a9881" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:29:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8cf1ce13-7c78-4112-b595-c4037b42e56c tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Acquiring lock "cinder-quobyte-d4c398f8-811c-47db-ba51-89cc942ec335" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:29:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8cf1ce13-7c78-4112-b595-c4037b42e56c tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Lock "cinder-quobyte-d4c398f8-811c-47db-ba51-89cc942ec335" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:29:30 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-8cf1ce13-7c78-4112-b595-c4037b42e56c tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Deleting offline snapshot d4c398f8-811c-47db-ba51-89cc942ec335 of volume 32b97284-5b97-4c88-99b7-f995899a9881 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:29:30 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-8cf1ce13-7c78-4112-b595-c4037b42e56c tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] snapshot_file for this snap is: volume-32b97284-5b97-4c88-99b7-f995899a9881.d4c398f8-811c-47db-ba51-89cc942ec335 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:29:30 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc6376d-a7b1-49f4-93f0-0f2098091e9a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:29:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8cf1ce13-7c78-4112-b595-c4037b42e56c tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881.d4c398f8-811c-47db-ba51-89cc942ec335 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:30 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881.d4c398f8-811c-47db-ba51-89cc942ec335 Nov 06 14:29:30 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:31 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8cf1ce13-7c78-4112-b595-c4037b42e56c tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881.d4c398f8-811c-47db-ba51-89cc942ec335" returned: 0 in 0.724s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:31 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-8cf1ce13-7c78-4112-b595-c4037b42e56c tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32b97284-5b97-4c88-99b7-f995899a9881(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:29:31 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08f0faf-c841-4973-becd-bb215321ea38]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:29:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8cf1ce13-7c78-4112-b595-c4037b42e56c tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:31 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881 Nov 06 14:29:31 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:32 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8cf1ce13-7c78-4112-b595-c4037b42e56c tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881" returned: 0 in 0.581s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8cf1ce13-7c78-4112-b595-c4037b42e56c tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881.d4c398f8-811c-47db-ba51-89cc942ec335 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:32 devstack sudo[90805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881.d4c398f8-811c-47db-ba51-89cc942ec335 Nov 06 14:29:32 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:32 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8cf1ce13-7c78-4112-b595-c4037b42e56c tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881.d4c398f8-811c-47db-ba51-89cc942ec335" returned: 0 in 0.645s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8cf1ce13-7c78-4112-b595-c4037b42e56c tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881.d4c398f8-811c-47db-ba51-89cc942ec335 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:32 devstack sudo[90810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881.d4c398f8-811c-47db-ba51-89cc942ec335 Nov 06 14:29:32 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:33 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8cf1ce13-7c78-4112-b595-c4037b42e56c tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881.d4c398f8-811c-47db-ba51-89cc942ec335" returned: 0 in 0.355s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:33 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=48,cinder:UPDATE=65,cinder:INSERT=11,cinder:DELETE=9 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:29:33 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=55,cinder:UPDATE=70,cinder:INSERT=17,cinder:DELETE=4 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:29:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8cf1ce13-7c78-4112-b595-c4037b42e56c tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Lock "cinder-quobyte-d4c398f8-811c-47db-ba51-89cc942ec335" released by "_delete_snapshot" :: held 2.576s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:29:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8cf1ce13-7c78-4112-b595-c4037b42e56c tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Lock "cinder-quobyte-32b97284-5b97-4c88-99b7-f995899a9881" released by "delete_snapshot" :: held 2.639s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:29:33 devstack cinder-volume[86854]: WARNING cinder.quota [None req-8cf1ce13-7c78-4112-b595-c4037b42e56c tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:29:33 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-8cf1ce13-7c78-4112-b595-c4037b42e56c tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Created reservations ['1bca0f4b-5a44-4d8e-a737-59bc709b6057', '77a7e0ca-7f82-484b-b9e6-9e46d6686cee', '42a825c4-7786-49c5-aa58-b711e3c30604', '730f8590-9c82-418b-8dd7-fe1abb7bfe7f'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:29:33 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-8cf1ce13-7c78-4112-b595-c4037b42e56c tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Delete snapshot completed successfully. Nov 06 14:29:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8cf1ce13-7c78-4112-b595-c4037b42e56c tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Lock "cinder-d4c398f8-811c-47db-ba51-89cc942ec335-delete_snapshot" released by "delete_snapshot" :: held 2.886s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:29:34 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9c29fa02-0d60-4cad-b09e-35f6754f0e18 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Acquiring lock "cinder-32b97284-5b97-4c88-99b7-f995899a9881-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:29:34 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9c29fa02-0d60-4cad-b09e-35f6754f0e18 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Lock "cinder-32b97284-5b97-4c88-99b7-f995899a9881-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:29:34 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9c29fa02-0d60-4cad-b09e-35f6754f0e18 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Acquiring lock "cinder-quobyte-32b97284-5b97-4c88-99b7-f995899a9881" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:29:34 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9c29fa02-0d60-4cad-b09e-35f6754f0e18 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Lock "cinder-quobyte-32b97284-5b97-4c88-99b7-f995899a9881" acquired by "delete_volume" :: waited 0.022s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:29:34 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[65473c7d-b5a7-4281-ab96-09d14d3c6cdd]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:29:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c29fa02-0d60-4cad-b09e-35f6754f0e18 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:34 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881 Nov 06 14:29:34 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:34 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c29fa02-0d60-4cad-b09e-35f6754f0e18 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881" returned: 0 in 0.444s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c29fa02-0d60-4cad-b09e-35f6754f0e18 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:34 devstack sudo[90856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881 Nov 06 14:29:34 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:34 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c29fa02-0d60-4cad-b09e-35f6754f0e18 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32b97284-5b97-4c88-99b7-f995899a9881" returned: 0 in 0.327s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9c29fa02-0d60-4cad-b09e-35f6754f0e18 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Lock "cinder-quobyte-32b97284-5b97-4c88-99b7-f995899a9881" released by "delete_volume" :: held 0.858s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-9c29fa02-0d60-4cad-b09e-35f6754f0e18 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Created reservations ['e0f758dd-2559-4367-a89d-b7eb302934b3', 'd7a2bea0-81e4-4d5d-828c-d7b39e834bfb', '50f19f7a-ab68-4894-8d80-de83f5954f5f', 'bcd89d5b-e840-4571-af5d-5e097184621d'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9c29fa02-0d60-4cad-b09e-35f6754f0e18 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9c29fa02-0d60-4cad-b09e-35f6754f0e18 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9c29fa02-0d60-4cad-b09e-35f6754f0e18 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9c29fa02-0d60-4cad-b09e-35f6754f0e18 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9c29fa02-0d60-4cad-b09e-35f6754f0e18 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c29fa02-0d60-4cad-b09e-35f6754f0e18 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:35 devstack sudo[90859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:29:35 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:35 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c29fa02-0d60-4cad-b09e-35f6754f0e18 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.276s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-9c29fa02-0d60-4cad-b09e-35f6754f0e18 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:29:35 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-9c29fa02-0d60-4cad-b09e-35f6754f0e18 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Deleted volume successfully. Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9c29fa02-0d60-4cad-b09e-35f6754f0e18 tempest-VolumeSnapshotQuotasNegativeTestJSON-574309156 None] Lock "cinder-32b97284-5b97-4c88-99b7-f995899a9881-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Flow 'volume_create_manager' (861426b4-4231-4c60-b2bb-0031bac4d3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1abde82b-9135-47da-aa3f-9644e315c84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1abde82b-9135-47da-aa3f-9644e315c84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1130991043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b474f1-5a9c-4785-82c3-fc403cc568a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4665ee96a1784c839748aa81488ec3bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:29:36Z,use_quota=True,user_id='18460c7969da437bb5f3a20a185a8d14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20053f49-0977-49ff-b04b-c0c388d68d2f),volume_type_id=20053f49-0977-49ff-b04b-c0c388d68d2f)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a300e86d-1484-41aa-bbfc-6e6a867b86d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a300e86d-1484-41aa-bbfc-6e6a867b86d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d794d1-6003-4720-aa5e-c4bfbb0c2853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d794d1-6003-4720-aa5e-c4bfbb0c2853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72b474f1-5a9c-4785-82c3-fc403cc568a2', 'volume_name': 'volume-72b474f1-5a9c-4785-82c3-fc403cc568a2', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839e9304-894b-4fef-a03d-279da6b06c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839e9304-894b-4fef-a03d-279da6b06c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e669267b-d6b4-42f5-88a9-8dbbf8678ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:35 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Volume 72b474f1-5a9c-4785-82c3-fc403cc568a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72b474f1-5a9c-4785-82c3-fc403cc568a2', 'volume_size': 1} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1130991043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b474f1-5a9c-4785-82c3-fc403cc568a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4665ee96a1784c839748aa81488ec3bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:29:36Z,use_quota=True,user_id='18460c7969da437bb5f3a20a185a8d14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20053f49-0977-49ff-b04b-c0c388d68d2f),volume_type_id=20053f49-0977-49ff-b04b-c0c388d68d2f)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Creating volume 72b474f1-5a9c-4785-82c3-fc403cc568a2 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:29:35 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:29:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-72b474f1-5a9c-4785-82c3-fc403cc568a2 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:36 devstack sudo[90862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-72b474f1-5a9c-4785-82c3-fc403cc568a2 1073741824 Nov 06 14:29:36 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:36 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-72b474f1-5a9c-4785-82c3-fc403cc568a2 1073741824" returned: 0 in 0.463s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-72b474f1-5a9c-4785-82c3-fc403cc568a2 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:36 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-72b474f1-5a9c-4785-82c3-fc403cc568a2 Nov 06 14:29:36 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:36 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-72b474f1-5a9c-4785-82c3-fc403cc568a2" returned: 0 in 0.288s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:29:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:29:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e669267b-d6b4-42f5-88a9-8dbbf8678ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b474f1-5a9c-4785-82c3-fc403cc568a2', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85f64e6c-87e4-4417-9c0c-1dd78eb78c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:36 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Volume volume-72b474f1-5a9c-4785-82c3-fc403cc568a2 (72b474f1-5a9c-4785-82c3-fc403cc568a2): created successfully Nov 06 14:29:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85f64e6c-87e4-4417-9c0c-1dd78eb78c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Flow 'volume_create_manager' (861426b4-4231-4c60-b2bb-0031bac4d3aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:29:36 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-55a95fee-b6d0-4843-95d9-e23ab8f9272a tempest-VolumeTypesAccessTest-1170959175 None] Created volume successfully. Nov 06 14:29:38 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-433eb314-b7aa-4850-bd24-dac1845f83c2 tempest-VolumeTypesAccessTest-1170959175 None] Acquiring lock "cinder-72b474f1-5a9c-4785-82c3-fc403cc568a2-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:29:38 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-433eb314-b7aa-4850-bd24-dac1845f83c2 tempest-VolumeTypesAccessTest-1170959175 None] Lock "cinder-72b474f1-5a9c-4785-82c3-fc403cc568a2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:29:38 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-433eb314-b7aa-4850-bd24-dac1845f83c2 tempest-VolumeTypesAccessTest-1170959175 None] Acquiring lock "cinder-quobyte-72b474f1-5a9c-4785-82c3-fc403cc568a2" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:29:38 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-433eb314-b7aa-4850-bd24-dac1845f83c2 tempest-VolumeTypesAccessTest-1170959175 None] Lock "cinder-quobyte-72b474f1-5a9c-4785-82c3-fc403cc568a2" acquired by "delete_volume" :: waited 0.032s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:29:38 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ada908-11b7-410a-97a2-332a6ec49bbd]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:29:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-433eb314-b7aa-4850-bd24-dac1845f83c2 tempest-VolumeTypesAccessTest-1170959175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-72b474f1-5a9c-4785-82c3-fc403cc568a2 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:38 devstack sudo[90871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-72b474f1-5a9c-4785-82c3-fc403cc568a2 Nov 06 14:29:38 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:38 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-433eb314-b7aa-4850-bd24-dac1845f83c2 tempest-VolumeTypesAccessTest-1170959175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-72b474f1-5a9c-4785-82c3-fc403cc568a2" returned: 0 in 0.424s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-433eb314-b7aa-4850-bd24-dac1845f83c2 tempest-VolumeTypesAccessTest-1170959175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-72b474f1-5a9c-4785-82c3-fc403cc568a2 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:38 devstack sudo[90876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-72b474f1-5a9c-4785-82c3-fc403cc568a2 Nov 06 14:29:38 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:38 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-433eb314-b7aa-4850-bd24-dac1845f83c2 tempest-VolumeTypesAccessTest-1170959175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-72b474f1-5a9c-4785-82c3-fc403cc568a2" returned: 0 in 0.326s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:39 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-433eb314-b7aa-4850-bd24-dac1845f83c2 tempest-VolumeTypesAccessTest-1170959175 None] Lock "cinder-quobyte-72b474f1-5a9c-4785-82c3-fc403cc568a2" released by "delete_volume" :: held 0.795s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:29:39 devstack cinder-volume[86854]: WARNING cinder.quota [None req-433eb314-b7aa-4850-bd24-dac1845f83c2 tempest-VolumeTypesAccessTest-1170959175 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1965261868 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1965261868, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:29:39 devstack cinder-volume[86854]: WARNING cinder.quota [None req-433eb314-b7aa-4850-bd24-dac1845f83c2 tempest-VolumeTypesAccessTest-1170959175 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1965261868 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1965261868, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:29:39 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-433eb314-b7aa-4850-bd24-dac1845f83c2 tempest-VolumeTypesAccessTest-1170959175 None] Created reservations ['4e8c1c23-d79e-47d6-86ad-88dafa196180', 'ed91648d-02f5-40bf-98e5-cd8c7ce244d6', '4042d4ef-6fcf-4c9f-92ab-134f61e6b009', 'bf445a9b-d9cc-45e9-8ed3-f3c655712cee'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:29:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-433eb314-b7aa-4850-bd24-dac1845f83c2 tempest-VolumeTypesAccessTest-1170959175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:29:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-433eb314-b7aa-4850-bd24-dac1845f83c2 tempest-VolumeTypesAccessTest-1170959175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:29:39 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-433eb314-b7aa-4850-bd24-dac1845f83c2 tempest-VolumeTypesAccessTest-1170959175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:29:39 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-433eb314-b7aa-4850-bd24-dac1845f83c2 tempest-VolumeTypesAccessTest-1170959175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:29:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-433eb314-b7aa-4850-bd24-dac1845f83c2 tempest-VolumeTypesAccessTest-1170959175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:29:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-433eb314-b7aa-4850-bd24-dac1845f83c2 tempest-VolumeTypesAccessTest-1170959175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:39 devstack sudo[90880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:29:39 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:39 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-433eb314-b7aa-4850-bd24-dac1845f83c2 tempest-VolumeTypesAccessTest-1170959175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.391s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:39 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-433eb314-b7aa-4850-bd24-dac1845f83c2 tempest-VolumeTypesAccessTest-1170959175 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:29:39 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-433eb314-b7aa-4850-bd24-dac1845f83c2 tempest-VolumeTypesAccessTest-1170959175 None] Deleted volume successfully. Nov 06 14:29:39 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-433eb314-b7aa-4850-bd24-dac1845f83c2 tempest-VolumeTypesAccessTest-1170959175 None] Lock "cinder-72b474f1-5a9c-4785-82c3-fc403cc568a2-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:29:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-24625e8b-ead5-4d81-82a2-a04ab3bf7e8d req-743f3aa6-11a0-4f6b-9a5a-23e29c0a6052 tempest-ServerActionsTestOtherA-1610590813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:29:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-24625e8b-ead5-4d81-82a2-a04ab3bf7e8d req-743f3aa6-11a0-4f6b-9a5a-23e29c0a6052 tempest-ServerActionsTestOtherA-1610590813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:29:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-24625e8b-ead5-4d81-82a2-a04ab3bf7e8d req-743f3aa6-11a0-4f6b-9a5a-23e29c0a6052 tempest-ServerActionsTestOtherA-1610590813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:29:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-24625e8b-ead5-4d81-82a2-a04ab3bf7e8d req-743f3aa6-11a0-4f6b-9a5a-23e29c0a6052 tempest-ServerActionsTestOtherA-1610590813 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e', 'name': 'volume-e363f1a1-7198-4c78-bc8a-e8a8feb1815d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a27f96c-bcc3-4122-975f-2d3a1acde1f0', 'enforce_multipath': True} {{(pid=86854) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 14:29:48 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-24625e8b-ead5-4d81-82a2-a04ab3bf7e8d req-743f3aa6-11a0-4f6b-9a5a-23e29c0a6052 tempest-ServerActionsTestOtherA-1610590813 None] attachment_update completed successfully. Nov 06 14:29:51 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:29:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Flow 'volume_create_manager' (f4715a8f-8145-420d-b9f3-38994ee6016d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:29:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73cb746b-1c38-4bb8-b218-e1830e0758a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73cb746b-1c38-4bb8-b218-e1830e0758a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2090078484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a5c4a8f-7057-46aa-89a2-b9963eb6da41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d98ff960ef62443abe5cb0d0c7203a5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:29:51Z,use_quota=True,user_id='11add271b4c346d188506c4f1b4da304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bf37f8c-2d34-4931-9595-0ce810c397d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bf37f8c-2d34-4931-9595-0ce810c397d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b352884f-de7f-4883-8e03-c26f9b638bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b352884f-de7f-4883-8e03-c26f9b638bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a5c4a8f-7057-46aa-89a2-b9963eb6da41', 'volume_name': 'volume-0a5c4a8f-7057-46aa-89a2-b9963eb6da41', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44461386-9ed6-4db3-bc54-56e6bf0a3f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44461386-9ed6-4db3-bc54-56e6bf0a3f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d38fa82a-c668-4458-86ef-67936cde35b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:51 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Volume 0a5c4a8f-7057-46aa-89a2-b9963eb6da41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a5c4a8f-7057-46aa-89a2-b9963eb6da41', 'volume_size': 1} Nov 06 14:29:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:29:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:29:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2090078484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a5c4a8f-7057-46aa-89a2-b9963eb6da41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d98ff960ef62443abe5cb0d0c7203a5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:29:51Z,use_quota=True,user_id='11add271b4c346d188506c4f1b4da304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:29:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Creating volume 0a5c4a8f-7057-46aa-89a2-b9963eb6da41 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:29:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:29:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:29:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:29:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:29:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:29:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:29:51 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:29:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0a5c4a8f-7057-46aa-89a2-b9963eb6da41 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:51 devstack sudo[91334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0a5c4a8f-7057-46aa-89a2-b9963eb6da41 1073741824 Nov 06 14:29:51 devstack sudo[91334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:52 devstack sudo[91334]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0a5c4a8f-7057-46aa-89a2-b9963eb6da41 1073741824" returned: 0 in 0.641s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0a5c4a8f-7057-46aa-89a2-b9963eb6da41 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:52 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0a5c4a8f-7057-46aa-89a2-b9963eb6da41 Nov 06 14:29:52 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:52 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0a5c4a8f-7057-46aa-89a2-b9963eb6da41" returned: 0 in 0.324s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d38fa82a-c668-4458-86ef-67936cde35b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a5c4a8f-7057-46aa-89a2-b9963eb6da41', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3cba214-b100-4962-92da-179afe48f480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:52 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Volume volume-0a5c4a8f-7057-46aa-89a2-b9963eb6da41 (0a5c4a8f-7057-46aa-89a2-b9963eb6da41): created successfully Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3cba214-b100-4962-92da-179afe48f480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Flow 'volume_create_manager' (f4715a8f-8145-420d-b9f3-38994ee6016d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:29:52 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-371238f5-1a83-4469-82cf-1163db2fb454 req-9cbac79e-10d3-47c1-930d-586c0f3ed459 tempest-ServerActionsTestOtherA-1610590813 None] Terminate volume connection completed successfully. Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-371238f5-1a83-4469-82cf-1163db2fb454 req-9cbac79e-10d3-47c1-930d-586c0f3ed459 tempest-ServerActionsTestOtherA-1610590813 None] Deleting attachment 9a27f96c-bcc3-4122-975f-2d3a1acde1f0. {{(pid=86854) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 14:29:52 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-50ec6b05-82e3-42c1-b50d-92ea2c0222ff tempest-VolumesTransfersTest-1638837784 None] Created volume successfully. Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Flow 'volume_create_manager' (fc1cda9d-cb3e-4502-a416-f9e31b371ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (941d00ab-63f2-4d4a-9999-ddb93558f5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (941d00ab-63f2-4d4a-9999-ddb93558f5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-47362788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86ce7c33-b3b1-458e-8a7f-f2ee71ad951b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa7b0b832d8a4713873784fa6136ca93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:29:53Z,use_quota=True,user_id='55877764a4634f9aa5fc9e9531c4a52f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (414ac1a5-1695-4611-9ff1-1946c694a64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (414ac1a5-1695-4611-9ff1-1946c694a64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ec12b1-48aa-4cfc-b559-3d72586790cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ec12b1-48aa-4cfc-b559-3d72586790cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86ce7c33-b3b1-458e-8a7f-f2ee71ad951b', 'volume_name': 'volume-86ce7c33-b3b1-458e-8a7f-f2ee71ad951b', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bbe2da6-6555-47d3-b349-e2bef662d1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bbe2da6-6555-47d3-b349-e2bef662d1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (654a9362-74a1-4ba2-bc62-b365318db35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:52 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Volume 86ce7c33-b3b1-458e-8a7f-f2ee71ad951b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86ce7c33-b3b1-458e-8a7f-f2ee71ad951b', 'volume_size': 1} Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-47362788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86ce7c33-b3b1-458e-8a7f-f2ee71ad951b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa7b0b832d8a4713873784fa6136ca93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:29:53Z,use_quota=True,user_id='55877764a4634f9aa5fc9e9531c4a52f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Creating volume 86ce7c33-b3b1-458e-8a7f-f2ee71ad951b {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:29:52 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:29:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-86ce7c33-b3b1-458e-8a7f-f2ee71ad951b 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:52 devstack sudo[91377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-86ce7c33-b3b1-458e-8a7f-f2ee71ad951b 1073741824 Nov 06 14:29:52 devstack sudo[91377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:53 devstack sudo[91377]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-86ce7c33-b3b1-458e-8a7f-f2ee71ad951b 1073741824" returned: 0 in 0.840s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-86ce7c33-b3b1-458e-8a7f-f2ee71ad951b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:53 devstack sudo[91410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-86ce7c33-b3b1-458e-8a7f-f2ee71ad951b Nov 06 14:29:53 devstack sudo[91410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-371238f5-1a83-4469-82cf-1163db2fb454 req-fcf9507c-35ec-4c21-80c4-d2a03668277d tempest-ServerActionsTestOtherA-1610590813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:29:54 devstack sudo[91410]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-86ce7c33-b3b1-458e-8a7f-f2ee71ad951b" returned: 0 in 0.280s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:29:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:29:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-371238f5-1a83-4469-82cf-1163db2fb454 req-fcf9507c-35ec-4c21-80c4-d2a03668277d tempest-ServerActionsTestOtherA-1610590813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.206s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:29:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (654a9362-74a1-4ba2-bc62-b365318db35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86ce7c33-b3b1-458e-8a7f-f2ee71ad951b', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b38b46-772a-4825-8e24-bdadf6b4f1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-371238f5-1a83-4469-82cf-1163db2fb454 req-fcf9507c-35ec-4c21-80c4-d2a03668277d tempest-ServerActionsTestOtherA-1610590813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:29:54 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Volume volume-86ce7c33-b3b1-458e-8a7f-f2ee71ad951b (86ce7c33-b3b1-458e-8a7f-f2ee71ad951b): created successfully Nov 06 14:29:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b38b46-772a-4825-8e24-bdadf6b4f1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Flow 'volume_create_manager' (fc1cda9d-cb3e-4502-a416-f9e31b371ca9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:29:54 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-66715a1b-d31c-4445-b9ff-1043175df453 tempest-AttachVolumeShelveTestJSON-1214937209 None] Created volume successfully. Nov 06 14:29:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-371238f5-1a83-4469-82cf-1163db2fb454 req-fcf9507c-35ec-4c21-80c4-d2a03668277d tempest-ServerActionsTestOtherA-1610590813 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e', 'name': 'volume-e363f1a1-7198-4c78-bc8a-e8a8feb1815d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '83a434c1-e77e-4e63-9779-e8984517ab28', 'enforce_multipath': True} {{(pid=86854) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 14:29:54 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-371238f5-1a83-4469-82cf-1163db2fb454 req-fcf9507c-35ec-4c21-80c4-d2a03668277d tempest-ServerActionsTestOtherA-1610590813 None] attachment_update completed successfully. Nov 06 14:29:55 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-5362b862-8643-494b-b104-4cb70c65061f tempest-VolumesTransfersTest-697746992 None] Transfer volume completed successfully. Nov 06 14:29:56 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-71e1cd66-675a-4282-aff2-5ec8dc054a7c tempest-VolumesTransfersTest-1763761460 None] Acquiring lock "cinder-0a5c4a8f-7057-46aa-89a2-b9963eb6da41-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:29:56 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-71e1cd66-675a-4282-aff2-5ec8dc054a7c tempest-VolumesTransfersTest-1763761460 None] Lock "cinder-0a5c4a8f-7057-46aa-89a2-b9963eb6da41-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:29:56 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-71e1cd66-675a-4282-aff2-5ec8dc054a7c tempest-VolumesTransfersTest-1763761460 None] Acquiring lock "cinder-quobyte-0a5c4a8f-7057-46aa-89a2-b9963eb6da41" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:29:56 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-71e1cd66-675a-4282-aff2-5ec8dc054a7c tempest-VolumesTransfersTest-1763761460 None] Lock "cinder-quobyte-0a5c4a8f-7057-46aa-89a2-b9963eb6da41" acquired by "delete_volume" :: waited 0.035s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:29:56 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[35da31a4-223d-4b4e-a302-d35365985d76]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:29:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-71e1cd66-675a-4282-aff2-5ec8dc054a7c tempest-VolumesTransfersTest-1763761460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0a5c4a8f-7057-46aa-89a2-b9963eb6da41 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:56 devstack sudo[91876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0a5c4a8f-7057-46aa-89a2-b9963eb6da41 Nov 06 14:29:56 devstack sudo[91876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Flow 'volume_create_manager' (cc8acb0a-18a7-49f8-851d-320aaafcd4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd15498-6c99-4b54-a6d6-95d46fcf7a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd15498-6c99-4b54-a6d6-95d46fcf7a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1166365822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f87b91-eb8c-4ca0-9e5d-a4b27644cdcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='518983b79fd04139adb0ae906c4e5e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:29:57Z,use_quota=True,user_id='985f42bfc77247a1a13dba3fec92e6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96ab549e-8d43-44a6-86d2-d6a2b1359be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:57 devstack sudo[91876]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96ab549e-8d43-44a6-86d2-d6a2b1359be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e021db-e499-4c86-bbe0-eccf2e06034c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e021db-e499-4c86-bbe0-eccf2e06034c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29f87b91-eb8c-4ca0-9e5d-a4b27644cdcf', 'volume_name': 'volume-29f87b91-eb8c-4ca0-9e5d-a4b27644cdcf', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b2d7a62-13b5-4818-9182-919021e98c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b2d7a62-13b5-4818-9182-919021e98c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f01ed9-a2a0-4394-8535-5a7ea652567d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:57 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Volume 29f87b91-eb8c-4ca0-9e5d-a4b27644cdcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29f87b91-eb8c-4ca0-9e5d-a4b27644cdcf', 'volume_size': 1} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1166365822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f87b91-eb8c-4ca0-9e5d-a4b27644cdcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='518983b79fd04139adb0ae906c4e5e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:29:57Z,use_quota=True,user_id='985f42bfc77247a1a13dba3fec92e6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Creating volume 29f87b91-eb8c-4ca0-9e5d-a4b27644cdcf {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:29:57 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-29f87b91-eb8c-4ca0-9e5d-a4b27644cdcf 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-71e1cd66-675a-4282-aff2-5ec8dc054a7c tempest-VolumesTransfersTest-1763761460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0a5c4a8f-7057-46aa-89a2-b9963eb6da41" returned: 0 in 0.822s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-71e1cd66-675a-4282-aff2-5ec8dc054a7c tempest-VolumesTransfersTest-1763761460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0a5c4a8f-7057-46aa-89a2-b9963eb6da41 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:57 devstack sudo[91900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-29f87b91-eb8c-4ca0-9e5d-a4b27644cdcf 1073741824 Nov 06 14:29:57 devstack sudo[91900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:57 devstack sudo[91901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0a5c4a8f-7057-46aa-89a2-b9963eb6da41 Nov 06 14:29:57 devstack sudo[91901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:57 devstack sudo[91901]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-71e1cd66-675a-4282-aff2-5ec8dc054a7c tempest-VolumesTransfersTest-1763761460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0a5c4a8f-7057-46aa-89a2-b9963eb6da41" returned: 0 in 0.375s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-71e1cd66-675a-4282-aff2-5ec8dc054a7c tempest-VolumesTransfersTest-1763761460 None] Lock "cinder-quobyte-0a5c4a8f-7057-46aa-89a2-b9963eb6da41" released by "delete_volume" :: held 1.266s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-71e1cd66-675a-4282-aff2-5ec8dc054a7c tempest-VolumesTransfersTest-1763761460 None] Created reservations ['6850f15f-e79f-4880-992a-9581f15a81cc', 'b1d887e9-fcd5-4e47-a82b-919013a2899c', '20d7a4f2-304b-4c7f-8e0a-70b304d84c8b', '4c90e2cf-eb50-434b-87a2-927247fe41d6'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-71e1cd66-675a-4282-aff2-5ec8dc054a7c tempest-VolumesTransfersTest-1763761460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-71e1cd66-675a-4282-aff2-5ec8dc054a7c tempest-VolumesTransfersTest-1763761460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-71e1cd66-675a-4282-aff2-5ec8dc054a7c tempest-VolumesTransfersTest-1763761460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-71e1cd66-675a-4282-aff2-5ec8dc054a7c tempest-VolumesTransfersTest-1763761460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-71e1cd66-675a-4282-aff2-5ec8dc054a7c tempest-VolumesTransfersTest-1763761460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:29:57 devstack sudo[91900]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-71e1cd66-675a-4282-aff2-5ec8dc054a7c tempest-VolumesTransfersTest-1763761460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-29f87b91-eb8c-4ca0-9e5d-a4b27644cdcf 1073741824" returned: 0 in 0.659s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:57 devstack sudo[91920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:29:57 devstack sudo[91920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-29f87b91-eb8c-4ca0-9e5d-a4b27644cdcf {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:58 devstack sudo[91922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-29f87b91-eb8c-4ca0-9e5d-a4b27644cdcf Nov 06 14:29:58 devstack sudo[91922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:58 devstack sudo[91920]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-71e1cd66-675a-4282-aff2-5ec8dc054a7c tempest-VolumesTransfersTest-1763761460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.503s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:58 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-71e1cd66-675a-4282-aff2-5ec8dc054a7c tempest-VolumesTransfersTest-1763761460 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:29:58 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-71e1cd66-675a-4282-aff2-5ec8dc054a7c tempest-VolumesTransfersTest-1763761460 None] Deleted volume successfully. Nov 06 14:29:58 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-71e1cd66-675a-4282-aff2-5ec8dc054a7c tempest-VolumesTransfersTest-1763761460 None] Lock "cinder-0a5c4a8f-7057-46aa-89a2-b9963eb6da41-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:29:58 devstack sudo[91922]: pam_unix(sudo:session): session closed for user root Nov 06 14:29:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-29f87b91-eb8c-4ca0-9e5d-a4b27644cdcf" returned: 0 in 0.510s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:29:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:29:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:29:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f01ed9-a2a0-4394-8535-5a7ea652567d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29f87b91-eb8c-4ca0-9e5d-a4b27644cdcf', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70fe319b-e684-457c-92c7-fec95ef6300b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:58 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Volume volume-29f87b91-eb8c-4ca0-9e5d-a4b27644cdcf (29f87b91-eb8c-4ca0-9e5d-a4b27644cdcf): created successfully Nov 06 14:29:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70fe319b-e684-457c-92c7-fec95ef6300b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Flow 'volume_create_manager' (cc8acb0a-18a7-49f8-851d-320aaafcd4d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:29:58 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-aeab6aa3-be4e-4664-94e4-4034e62d39a9 tempest-AbsoluteLimitsTests-246925838 None] Created volume successfully. Nov 06 14:29:59 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:29:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Flow 'volume_create_manager' (d44279ed-4134-4526-99f0-4b6ec28d1011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:29:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d4ffaf-0e19-4836-9699-c15208bcd394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d4ffaf-0e19-4836-9699-c15208bcd394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1686221943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a675802-1e37-47c2-a7ec-47646714b53f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d98ff960ef62443abe5cb0d0c7203a5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:29:59Z,use_quota=True,user_id='11add271b4c346d188506c4f1b4da304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02edcb13-92ee-4f5b-b5bb-7f1bc9deb013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02edcb13-92ee-4f5b-b5bb-7f1bc9deb013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b32b074-c4ef-4ab0-8beb-d7c21f2d1c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b32b074-c4ef-4ab0-8beb-d7c21f2d1c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a675802-1e37-47c2-a7ec-47646714b53f', 'volume_name': 'volume-6a675802-1e37-47c2-a7ec-47646714b53f', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f32290cc-8bed-4005-b701-01987d0871f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f32290cc-8bed-4005-b701-01987d0871f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:29:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452ba73d-89d7-4b26-92e3-bea9fde1699a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:29:59 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Volume 6a675802-1e37-47c2-a7ec-47646714b53f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a675802-1e37-47c2-a7ec-47646714b53f', 'volume_size': 1} Nov 06 14:29:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:29:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:29:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1686221943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a675802-1e37-47c2-a7ec-47646714b53f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d98ff960ef62443abe5cb0d0c7203a5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:29:59Z,use_quota=True,user_id='11add271b4c346d188506c4f1b4da304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:29:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Creating volume 6a675802-1e37-47c2-a7ec-47646714b53f {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:29:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:29:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:29:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:29:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:29:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:29:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:29:59 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:29:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6a675802-1e37-47c2-a7ec-47646714b53f 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:29:59 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-68d1aec4-092c-4394-ac79-6867824f715a tempest-AbsoluteLimitsTests-246925838 None] Acquiring lock "cinder-29f87b91-eb8c-4ca0-9e5d-a4b27644cdcf-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:29:59 devstack sudo[91928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6a675802-1e37-47c2-a7ec-47646714b53f 1073741824 Nov 06 14:29:59 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:29:59 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-68d1aec4-092c-4394-ac79-6867824f715a tempest-AbsoluteLimitsTests-246925838 None] Lock "cinder-29f87b91-eb8c-4ca0-9e5d-a4b27644cdcf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:29:59 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-68d1aec4-092c-4394-ac79-6867824f715a tempest-AbsoluteLimitsTests-246925838 None] Acquiring lock "cinder-quobyte-29f87b91-eb8c-4ca0-9e5d-a4b27644cdcf" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:29:59 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-68d1aec4-092c-4394-ac79-6867824f715a tempest-AbsoluteLimitsTests-246925838 None] Lock "cinder-quobyte-29f87b91-eb8c-4ca0-9e5d-a4b27644cdcf" acquired by "delete_volume" :: waited 0.028s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:29:59 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5685b7-71b9-4c6f-964d-421d843dc292]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:29:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-68d1aec4-092c-4394-ac79-6867824f715a tempest-AbsoluteLimitsTests-246925838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-29f87b91-eb8c-4ca0-9e5d-a4b27644cdcf {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:00 devstack sudo[91930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-29f87b91-eb8c-4ca0-9e5d-a4b27644cdcf Nov 06 14:30:00 devstack sudo[91930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:00 devstack sudo[91930]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-68d1aec4-092c-4394-ac79-6867824f715a tempest-AbsoluteLimitsTests-246925838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-29f87b91-eb8c-4ca0-9e5d-a4b27644cdcf" returned: 0 in 0.618s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-68d1aec4-092c-4394-ac79-6867824f715a tempest-AbsoluteLimitsTests-246925838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-29f87b91-eb8c-4ca0-9e5d-a4b27644cdcf {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:00 devstack sudo[91974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-29f87b91-eb8c-4ca0-9e5d-a4b27644cdcf Nov 06 14:30:00 devstack sudo[91974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:00 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6a675802-1e37-47c2-a7ec-47646714b53f 1073741824" returned: 0 in 0.901s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6a675802-1e37-47c2-a7ec-47646714b53f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:00 devstack sudo[91976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6a675802-1e37-47c2-a7ec-47646714b53f Nov 06 14:30:00 devstack sudo[91976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:00 devstack sudo[91974]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-68d1aec4-092c-4394-ac79-6867824f715a tempest-AbsoluteLimitsTests-246925838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-29f87b91-eb8c-4ca0-9e5d-a4b27644cdcf" returned: 0 in 0.425s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-68d1aec4-092c-4394-ac79-6867824f715a tempest-AbsoluteLimitsTests-246925838 None] Lock "cinder-quobyte-29f87b91-eb8c-4ca0-9e5d-a4b27644cdcf" released by "delete_volume" :: held 1.124s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:30:01 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-68d1aec4-092c-4394-ac79-6867824f715a tempest-AbsoluteLimitsTests-246925838 None] Created reservations ['5a934587-34ed-4717-955e-27061be6cd72', '8998c195-eb1b-4bab-9839-4450573b151d', 'f598697f-2244-4861-8cfb-3bddf56f1016', 'd73dc385-9d78-4571-9dd8-936a880177e3'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:30:01 devstack sudo[91976]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6a675802-1e37-47c2-a7ec-47646714b53f" returned: 0 in 0.416s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:01 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:30:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452ba73d-89d7-4b26-92e3-bea9fde1699a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a675802-1e37-47c2-a7ec-47646714b53f', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b7d590-2009-4d70-a586-b08c6bfa53d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:01 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Volume volume-6a675802-1e37-47c2-a7ec-47646714b53f (6a675802-1e37-47c2-a7ec-47646714b53f): created successfully Nov 06 14:30:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b7d590-2009-4d70-a586-b08c6bfa53d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Flow 'volume_create_manager' (d44279ed-4134-4526-99f0-4b6ec28d1011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:30:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-68d1aec4-092c-4394-ac79-6867824f715a tempest-AbsoluteLimitsTests-246925838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-68d1aec4-092c-4394-ac79-6867824f715a tempest-AbsoluteLimitsTests-246925838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:01 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-68d1aec4-092c-4394-ac79-6867824f715a tempest-AbsoluteLimitsTests-246925838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:30:01 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-68d1aec4-092c-4394-ac79-6867824f715a tempest-AbsoluteLimitsTests-246925838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:30:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-68d1aec4-092c-4394-ac79-6867824f715a tempest-AbsoluteLimitsTests-246925838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-68d1aec4-092c-4394-ac79-6867824f715a tempest-AbsoluteLimitsTests-246925838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:01 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-eb75ce8d-5306-4056-b8d9-494cfe92213c tempest-VolumesTransfersTest-1638837784 None] Created volume successfully. Nov 06 14:30:01 devstack sudo[91982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:30:01 devstack sudo[91982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:01 devstack sudo[91982]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-68d1aec4-092c-4394-ac79-6867824f715a tempest-AbsoluteLimitsTests-246925838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.423s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:01 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-68d1aec4-092c-4394-ac79-6867824f715a tempest-AbsoluteLimitsTests-246925838 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:30:01 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-68d1aec4-092c-4394-ac79-6867824f715a tempest-AbsoluteLimitsTests-246925838 None] Deleted volume successfully. Nov 06 14:30:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-68d1aec4-092c-4394-ac79-6867824f715a tempest-AbsoluteLimitsTests-246925838 None] Lock "cinder-29f87b91-eb8c-4ca0-9e5d-a4b27644cdcf-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:30:02 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-cb75dff7-f104-42d2-a52c-c3aff062cc9e tempest-VolumesTransfersTest-1763761460 None] Acquiring lock "cinder-6a675802-1e37-47c2-a7ec-47646714b53f-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:30:02 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-cb75dff7-f104-42d2-a52c-c3aff062cc9e tempest-VolumesTransfersTest-1763761460 None] Lock "cinder-6a675802-1e37-47c2-a7ec-47646714b53f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:30:02 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-cb75dff7-f104-42d2-a52c-c3aff062cc9e tempest-VolumesTransfersTest-1763761460 None] Acquiring lock "cinder-quobyte-6a675802-1e37-47c2-a7ec-47646714b53f" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:30:02 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-cb75dff7-f104-42d2-a52c-c3aff062cc9e tempest-VolumesTransfersTest-1763761460 None] Lock "cinder-quobyte-6a675802-1e37-47c2-a7ec-47646714b53f" acquired by "delete_volume" :: waited 0.030s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:30:02 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[76aa0499-1649-4f0f-983f-2598d2b93874]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:30:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cb75dff7-f104-42d2-a52c-c3aff062cc9e tempest-VolumesTransfersTest-1763761460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6a675802-1e37-47c2-a7ec-47646714b53f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:02 devstack sudo[91985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6a675802-1e37-47c2-a7ec-47646714b53f Nov 06 14:30:02 devstack sudo[91985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:02 devstack sudo[91985]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cb75dff7-f104-42d2-a52c-c3aff062cc9e tempest-VolumesTransfersTest-1763761460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6a675802-1e37-47c2-a7ec-47646714b53f" returned: 0 in 0.398s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cb75dff7-f104-42d2-a52c-c3aff062cc9e tempest-VolumesTransfersTest-1763761460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6a675802-1e37-47c2-a7ec-47646714b53f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:02 devstack sudo[91990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6a675802-1e37-47c2-a7ec-47646714b53f Nov 06 14:30:02 devstack sudo[91990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:02 devstack sudo[91990]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cb75dff7-f104-42d2-a52c-c3aff062cc9e tempest-VolumesTransfersTest-1763761460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6a675802-1e37-47c2-a7ec-47646714b53f" returned: 0 in 0.409s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:02 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-cb75dff7-f104-42d2-a52c-c3aff062cc9e tempest-VolumesTransfersTest-1763761460 None] Lock "cinder-quobyte-6a675802-1e37-47c2-a7ec-47646714b53f" released by "delete_volume" :: held 0.879s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:30:03 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-cb75dff7-f104-42d2-a52c-c3aff062cc9e tempest-VolumesTransfersTest-1763761460 None] Created reservations ['f6212a7f-cf23-4c47-8cf8-88b4a647d188', 'd3266f2a-4ce9-4c27-b07a-1a32d1bbf230', '93e9bdbc-556e-4f7a-8ec4-a2ed8048150d', '0ee74e82-bc67-45e4-8c38-c844180405a6'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:30:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-cb75dff7-f104-42d2-a52c-c3aff062cc9e tempest-VolumesTransfersTest-1763761460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-cb75dff7-f104-42d2-a52c-c3aff062cc9e tempest-VolumesTransfersTest-1763761460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:03 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-cb75dff7-f104-42d2-a52c-c3aff062cc9e tempest-VolumesTransfersTest-1763761460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:30:03 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-cb75dff7-f104-42d2-a52c-c3aff062cc9e tempest-VolumesTransfersTest-1763761460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:30:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-cb75dff7-f104-42d2-a52c-c3aff062cc9e tempest-VolumesTransfersTest-1763761460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cb75dff7-f104-42d2-a52c-c3aff062cc9e tempest-VolumesTransfersTest-1763761460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:03 devstack sudo[91994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:30:03 devstack sudo[91994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:03 devstack sudo[91994]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cb75dff7-f104-42d2-a52c-c3aff062cc9e tempest-VolumesTransfersTest-1763761460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.306s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:03 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-cb75dff7-f104-42d2-a52c-c3aff062cc9e tempest-VolumesTransfersTest-1763761460 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:30:03 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-cb75dff7-f104-42d2-a52c-c3aff062cc9e tempest-VolumesTransfersTest-1763761460 None] Deleted volume successfully. Nov 06 14:30:03 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-cb75dff7-f104-42d2-a52c-c3aff062cc9e tempest-VolumesTransfersTest-1763761460 None] Lock "cinder-6a675802-1e37-47c2-a7ec-47646714b53f-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:30:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-f3dd59f7-55ac-4040-90f6-8401a05d7580 req-debc1817-b937-40c3-b1f4-c68435ab166b tempest-AttachVolumeShelveTestJSON-1214937209 None] No connector for attachment 02831739-54da-487e-aef3-6844c5518321; skipping storage backend terminate_connection call. {{(pid=86854) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 06 14:30:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-f3dd59f7-55ac-4040-90f6-8401a05d7580 req-debc1817-b937-40c3-b1f4-c68435ab166b tempest-AttachVolumeShelveTestJSON-1214937209 None] Deleting attachment 02831739-54da-487e-aef3-6844c5518321. {{(pid=86854) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Flow 'volume_create_manager' (8f8e053e-32ad-448e-9926-7522c499d150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0829a6ab-aa95-49fa-904d-8f05baad75fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0829a6ab-aa95-49fa-904d-8f05baad75fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-277880820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e01af61fc14eea9e0df028fa04a89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:30:13Z,use_quota=True,user_id='8061b1cac5a649319b4cee191c393e2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033159f8-6e6d-43c9-9417-15a182e79b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033159f8-6e6d-43c9-9417-15a182e79b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31ee0d6-1158-4084-84f4-cb2e76afc699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31ee0d6-1158-4084-84f4-cb2e76afc699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4', 'volume_name': 'volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19deda30-9c69-4b36-afc3-f3f8f5066925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19deda30-9c69-4b36-afc3-f3f8f5066925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27abacf3-16bb-4a11-af8d-1a237a412d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:13 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Volume cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4', 'volume_size': 1} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-277880820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e01af61fc14eea9e0df028fa04a89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:30:13Z,use_quota=True,user_id='8061b1cac5a649319b4cee191c393e2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Creating volume cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:30:13 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:13 devstack sudo[92085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4 1073741824 Nov 06 14:30:13 devstack sudo[92085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Flow 'volume_create_manager' (e7d066b4-c462-4783-bc69-4e9ac05c58d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f7d1448-d3c5-4827-aab7-0c49ba80a9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f7d1448-d3c5-4827-aab7-0c49ba80a9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1871313619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a8d9cee-f055-4fef-a72a-59dc96a6a474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b86cb6a4ed40efa2bf138e8ac640af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:30:14Z,use_quota=True,user_id='33af6f79357945fc91dd2ad48e331b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4acdd519-5f16-4fe2-bb67-495debee1441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4acdd519-5f16-4fe2-bb67-495debee1441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830eaeb0-ac33-4331-a9fd-7dba1c3253c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830eaeb0-ac33-4331-a9fd-7dba1c3253c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a8d9cee-f055-4fef-a72a-59dc96a6a474', 'volume_name': 'volume-7a8d9cee-f055-4fef-a72a-59dc96a6a474', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e8ceb3-d6d8-472b-aad6-8ea59feacd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e8ceb3-d6d8-472b-aad6-8ea59feacd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d433b0c7-6d87-4d6b-8168-d40d08154f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:13 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Volume 7a8d9cee-f055-4fef-a72a-59dc96a6a474: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a8d9cee-f055-4fef-a72a-59dc96a6a474', 'volume_size': 1} Nov 06 14:30:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:14 devstack sudo[92085]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4 1073741824" returned: 0 in 0.506s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:14 devstack sudo[92092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4 Nov 06 14:30:14 devstack sudo[92092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:14 devstack sudo[92092]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4" returned: 0 in 0.326s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:30:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.773s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1871313619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a8d9cee-f055-4fef-a72a-59dc96a6a474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b86cb6a4ed40efa2bf138e8ac640af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:30:14Z,use_quota=True,user_id='33af6f79357945fc91dd2ad48e331b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:30:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Creating volume 7a8d9cee-f055-4fef-a72a-59dc96a6a474 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:30:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:30:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:30:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:30:14 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:30:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7a8d9cee-f055-4fef-a72a-59dc96a6a474 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:14 devstack sudo[92095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7a8d9cee-f055-4fef-a72a-59dc96a6a474 1073741824 Nov 06 14:30:14 devstack sudo[92095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27abacf3-16bb-4a11-af8d-1a237a412d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f9935fc-6c4a-4568-9740-f13747475aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:14 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Volume volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4 (cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4): created successfully Nov 06 14:30:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f9935fc-6c4a-4568-9740-f13747475aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Flow 'volume_create_manager' (8f8e053e-32ad-448e-9926-7522c499d150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:30:14 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-696c4ac3-b172-4c0f-88eb-558e48011845 tempest-VolumesCloneTest-163388102 None] Created volume successfully. Nov 06 14:30:15 devstack sudo[92095]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7a8d9cee-f055-4fef-a72a-59dc96a6a474 1073741824" returned: 0 in 0.519s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7a8d9cee-f055-4fef-a72a-59dc96a6a474 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:15 devstack sudo[92101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7a8d9cee-f055-4fef-a72a-59dc96a6a474 Nov 06 14:30:15 devstack sudo[92101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:15 devstack sudo[92101]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7a8d9cee-f055-4fef-a72a-59dc96a6a474" returned: 0 in 0.275s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:30:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d433b0c7-6d87-4d6b-8168-d40d08154f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a8d9cee-f055-4fef-a72a-59dc96a6a474', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7ce62db-821c-4414-a0a0-82c1ec94b547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:15 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Volume volume-7a8d9cee-f055-4fef-a72a-59dc96a6a474 (7a8d9cee-f055-4fef-a72a-59dc96a6a474): created successfully Nov 06 14:30:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7ce62db-821c-4414-a0a0-82c1ec94b547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Flow 'volume_create_manager' (e7d066b4-c462-4783-bc69-4e9ac05c58d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:30:15 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-10caf411-357a-4646-921c-53e3ecbcaf87 tempest-VolumesTransfersV355Test-755630343 None] Created volume successfully. Nov 06 14:30:15 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:30:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Flow 'volume_create_manager' (ea8137c0-dc5d-4489-85ed-11531f98411c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:30:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a57ad4d4-d6dd-4c8e-b050-064c83609cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a57ad4d4-d6dd-4c8e-b050-064c83609cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1412437232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c481d146-4e16-41f4-b19d-0f37ffddf7ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e01af61fc14eea9e0df028fa04a89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:30:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4,status='creating',terminated_at=None,updated_at=2026-11-06T13:30:16Z,use_quota=True,user_id='8061b1cac5a649319b4cee191c393e2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9b930f-3179-4857-b139-ec68ff7bf7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9b930f-3179-4857-b139-ec68ff7bf7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b015e6e5-c211-4d27-824b-963515263814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b015e6e5-c211-4d27-824b-963515263814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c481d146-4e16-41f4-b19d-0f37ffddf7ba', 'volume_name': 'volume-c481d146-4e16-41f4-b19d-0f37ffddf7ba', 'volume_size': 2, 'source_volid': 'cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4', 'source_volstatus': 'available'}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67334441-1334-4a01-b313-caf665bf4ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67334441-1334-4a01-b313-caf665bf4ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3117190c-f18c-4623-b3a5-945eeb4e2f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:16 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Volume c481d146-4e16-41f4-b19d-0f37ffddf7ba: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c481d146-4e16-41f4-b19d-0f37ffddf7ba', 'volume_size': 2, 'source_volid': 'cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4', 'source_volstatus': 'available'} Nov 06 14:30:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:16 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Cloning volume cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4 to volume c481d146-4e16-41f4-b19d-0f37ffddf7ba Nov 06 14:30:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Creating offline snapshot d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8 of volume cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:30:16 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c730759-9be0-477d-b718-42d7e26a7d9c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:30:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:16 devstack sudo[92143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4 Nov 06 14:30:16 devstack sudo[92143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:16 devstack sudo[92143]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4" returned: 0 in 0.392s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:16 devstack sudo[92157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8 1G Nov 06 14:30:16 devstack sudo[92157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:17 devstack sudo[92157]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8 1G" returned: 0 in 0.541s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:17 devstack sudo[92171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8 Nov 06 14:30:17 devstack sudo[92171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:17 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-2cf60017-c437-4d59-92e2-51a5d57ba87b tempest-VolumesTransfersV355Test-1378424284 None] Transfer volume completed successfully. Nov 06 14:30:17 devstack sudo[92171]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8" returned: 0 in 0.402s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:17 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8 is being set with open permissions: ugo+rw Nov 06 14:30:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:17 devstack sudo[92177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8 Nov 06 14:30:17 devstack sudo[92177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:17 devstack sudo[92177]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8" returned: 0 in 0.308s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:17 devstack sudo[92180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.info Nov 06 14:30:17 devstack sudo[92180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:17 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9c11c1b5-90bb-4203-a773-5f9ad1cb2dff tempest-VolumesTransfersV355Test-1275170717 None] Acquiring lock "cinder-7a8d9cee-f055-4fef-a72a-59dc96a6a474-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:30:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9c11c1b5-90bb-4203-a773-5f9ad1cb2dff tempest-VolumesTransfersV355Test-1275170717 None] Lock "cinder-7a8d9cee-f055-4fef-a72a-59dc96a6a474-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:30:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9c11c1b5-90bb-4203-a773-5f9ad1cb2dff tempest-VolumesTransfersV355Test-1275170717 None] Acquiring lock "cinder-quobyte-7a8d9cee-f055-4fef-a72a-59dc96a6a474" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:30:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9c11c1b5-90bb-4203-a773-5f9ad1cb2dff tempest-VolumesTransfersV355Test-1275170717 None] Lock "cinder-quobyte-7a8d9cee-f055-4fef-a72a-59dc96a6a474" acquired by "delete_volume" :: waited 0.022s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:30:18 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fc1555-b840-4323-ba61-512d18ee5a96]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:30:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c11c1b5-90bb-4203-a773-5f9ad1cb2dff tempest-VolumesTransfersV355Test-1275170717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7a8d9cee-f055-4fef-a72a-59dc96a6a474 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:18 devstack sudo[92180]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.info" returned: 0 in 0.296s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:18 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.info is being set with open permissions: ugo+rw Nov 06 14:30:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:18 devstack sudo[92184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.info Nov 06 14:30:18 devstack sudo[92184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:18 devstack sudo[92183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7a8d9cee-f055-4fef-a72a-59dc96a6a474 Nov 06 14:30:18 devstack sudo[92183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:18 devstack sudo[92184]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.info" returned: 0 in 0.268s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Acquiring lock "cinder-quobyte-c481d146-4e16-41f4-b19d-0f37ffddf7ba" by "_copy_volume_from_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:30:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Lock "cinder-quobyte-c481d146-4e16-41f4-b19d-0f37ffddf7ba" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:30:18 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] snapshot: d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8, volume: c481d146-4e16-41f4-b19d-0f37ffddf7ba, {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 14:30:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:18 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:30:18 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:30:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:18 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[28214946-506f-4593-bd0b-b713354e00e3]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:30:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:18 devstack sudo[92183]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c11c1b5-90bb-4203-a773-5f9ad1cb2dff tempest-VolumesTransfersV355Test-1275170717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7a8d9cee-f055-4fef-a72a-59dc96a6a474" returned: 0 in 0.425s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c11c1b5-90bb-4203-a773-5f9ad1cb2dff tempest-VolumesTransfersV355Test-1275170717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7a8d9cee-f055-4fef-a72a-59dc96a6a474 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:18 devstack sudo[92192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7a8d9cee-f055-4fef-a72a-59dc96a6a474 Nov 06 14:30:18 devstack sudo[92192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:18 devstack sudo[92191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8 Nov 06 14:30:18 devstack sudo[92191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:19 devstack sudo[92192]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c11c1b5-90bb-4203-a773-5f9ad1cb2dff tempest-VolumesTransfersV355Test-1275170717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7a8d9cee-f055-4fef-a72a-59dc96a6a474" returned: 0 in 0.510s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9c11c1b5-90bb-4203-a773-5f9ad1cb2dff tempest-VolumesTransfersV355Test-1275170717 None] Lock "cinder-quobyte-7a8d9cee-f055-4fef-a72a-59dc96a6a474" released by "delete_volume" :: held 1.016s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:30:19 devstack sudo[92191]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8" returned: 0 in 0.664s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:30:19 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f35c378-098d-4328-807d-6f851f0c031a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:30:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:19 devstack sudo[92241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4 Nov 06 14:30:19 devstack sudo[92241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:19 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-9c11c1b5-90bb-4203-a773-5f9ad1cb2dff tempest-VolumesTransfersV355Test-1275170717 None] Created reservations ['d237ea4a-3174-4419-ad5b-3eee9aeb05ae', '89850313-6deb-47c7-a566-a58a98755e4c', '7a652896-c8ff-4efb-b6fb-e8b3ee0387bc', 'b04d285e-cf26-409d-aacd-e21c8be24f35'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:30:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9c11c1b5-90bb-4203-a773-5f9ad1cb2dff tempest-VolumesTransfersV355Test-1275170717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9c11c1b5-90bb-4203-a773-5f9ad1cb2dff tempest-VolumesTransfersV355Test-1275170717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9c11c1b5-90bb-4203-a773-5f9ad1cb2dff tempest-VolumesTransfersV355Test-1275170717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:30:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9c11c1b5-90bb-4203-a773-5f9ad1cb2dff tempest-VolumesTransfersV355Test-1275170717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:30:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9c11c1b5-90bb-4203-a773-5f9ad1cb2dff tempest-VolumesTransfersV355Test-1275170717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c11c1b5-90bb-4203-a773-5f9ad1cb2dff tempest-VolumesTransfersV355Test-1275170717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:19 devstack sudo[92261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:30:19 devstack sudo[92261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:19 devstack sudo[92241]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4" returned: 0 in 0.644s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4 {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 14:30:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Creating direct copy from snapshot {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 14:30:19 devstack cinder-volume[86854]: DEBUG cinder.utils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Path /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c481d146-4e16-41f4-b19d-0f37ffddf7ba not found in is_blk_device check {{(pid=86854) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 14:30:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c481d146-4e16-41f4-b19d-0f37ffddf7ba {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:19 devstack sudo[92261]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c11c1b5-90bb-4203-a773-5f9ad1cb2dff tempest-VolumesTransfersV355Test-1275170717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.411s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:19 devstack sudo[92273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c481d146-4e16-41f4-b19d-0f37ffddf7ba Nov 06 14:30:19 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-9c11c1b5-90bb-4203-a773-5f9ad1cb2dff tempest-VolumesTransfersV355Test-1275170717 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:30:19 devstack sudo[92273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:19 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-9c11c1b5-90bb-4203-a773-5f9ad1cb2dff tempest-VolumesTransfersV355Test-1275170717 None] Deleted volume successfully. Nov 06 14:30:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9c11c1b5-90bb-4203-a773-5f9ad1cb2dff tempest-VolumesTransfersV355Test-1275170717 None] Lock "cinder-7a8d9cee-f055-4fef-a72a-59dc96a6a474-delete_volume" released by "delete_volume" :: held 1.989s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:30:21 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:30:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Flow 'volume_create_manager' (642115c6-eec1-4c8e-9a6d-4677914950c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:30:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e0f1d9-a55c-45f8-bd9a-0c4fe0ae66cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e0f1d9-a55c-45f8-bd9a-0c4fe0ae66cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-619402284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f8b84f-b5a8-4233-969f-37549457af03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b86cb6a4ed40efa2bf138e8ac640af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:30:22Z,use_quota=True,user_id='33af6f79357945fc91dd2ad48e331b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9798c878-f930-47fa-96d6-b03e2d3a2a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9798c878-f930-47fa-96d6-b03e2d3a2a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30cdd49-11a1-4aef-a566-a821cf464c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30cdd49-11a1-4aef-a566-a821cf464c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9f8b84f-b5a8-4233-969f-37549457af03', 'volume_name': 'volume-e9f8b84f-b5a8-4233-969f-37549457af03', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fbf8e85-3429-4bb3-bc93-0cecb3020f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:22 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fbf8e85-3429-4bb3-bc93-0cecb3020f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:22 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc3c186-f893-434a-9acd-1ba9b55b52d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:22 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Volume e9f8b84f-b5a8-4233-969f-37549457af03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9f8b84f-b5a8-4233-969f-37549457af03', 'volume_size': 1} Nov 06 14:30:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:30:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:30:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:30:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:23 devstack sudo[92303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:30:23 devstack sudo[92303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:23 devstack sudo[92303]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.829s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:23 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:30:28 devstack sudo[92273]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c481d146-4e16-41f4-b19d-0f37ffddf7ba" returned: 0 in 8.999s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:28 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Image conversion details: src /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4, size 1024.00 MB, duration 9.00 sec, destination /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c481d146-4e16-41f4-b19d-0f37ffddf7ba {{(pid=86854) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 14:30:28 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Converted 1024.00 MB image at 113.78 MB/s Nov 06 14:30:28 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c481d146-4e16-41f4-b19d-0f37ffddf7ba is being set with open permissions: ugo+rw Nov 06 14:30:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c481d146-4e16-41f4-b19d-0f37ffddf7ba {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:28 devstack sudo[92308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c481d146-4e16-41f4-b19d-0f37ffddf7ba Nov 06 14:30:28 devstack sudo[92308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:29 devstack sudo[92308]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c481d146-4e16-41f4-b19d-0f37ffddf7ba" returned: 0 in 0.240s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:29 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Lock "cinder-quobyte-c481d146-4e16-41f4-b19d-0f37ffddf7ba" released by "_copy_volume_from_snapshot" :: held 10.662s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:30:29 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Acquiring lock "cinder-quobyte-d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:30:29 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Lock "cinder-quobyte-d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:30:29 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Deleting offline snapshot d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8 of volume cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:30:29 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] snapshot_file for this snap is: volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:30:29 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffaeab0e-652d-4dbd-9b26-89c466c7ca6c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:30:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:29 devstack sudo[92312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8 Nov 06 14:30:29 devstack sudo[92312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:29 devstack sudo[92312]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8" returned: 0 in 0.365s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:29 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:30:29 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3eddb3c-b303-4f2d-bfa2-fd6eadbd2ae5]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:30:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:29 devstack sudo[92317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4 Nov 06 14:30:29 devstack sudo[92317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:30 devstack sudo[92317]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4" returned: 0 in 0.523s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:30 devstack sudo[92322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8 Nov 06 14:30:30 devstack sudo[92322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:30 devstack sudo[92322]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8" returned: 0 in 0.344s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:30 devstack sudo[92327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8 Nov 06 14:30:30 devstack sudo[92327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:30 devstack sudo[92327]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4.d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8" returned: 0 in 0.233s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Lock "cinder-quobyte-d1ead826-dbbd-4db9-a6d6-1d60ffa3a6e8" released by "_delete_snapshot" :: held 1.561s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:30:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.665s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.762s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:30 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-619402284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f8b84f-b5a8-4233-969f-37549457af03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b86cb6a4ed40efa2bf138e8ac640af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:30:22Z,use_quota=True,user_id='33af6f79357945fc91dd2ad48e331b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:30:30 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Creating volume e9f8b84f-b5a8-4233-969f-37549457af03 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:30:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:30 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:30:30 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:30:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:30 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:30:30 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:30:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9f8b84f-b5a8-4233-969f-37549457af03 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:30 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3117190c-f18c-4623-b3a5-945eeb4e2f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c481d146-4e16-41f4-b19d-0f37ffddf7ba', 'volume_size': 2, 'source_volid': 'cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4', 'source_volstatus': 'available'}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:30 devstack sudo[92331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9f8b84f-b5a8-4233-969f-37549457af03 1073741824 Nov 06 14:30:30 devstack sudo[92331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:30 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2881e7f-c897-4144-8f77-9a0d57375055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:30 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Volume volume-c481d146-4e16-41f4-b19d-0f37ffddf7ba (c481d146-4e16-41f4-b19d-0f37ffddf7ba): created successfully Nov 06 14:30:30 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2881e7f-c897-4144-8f77-9a0d57375055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:30 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Flow 'volume_create_manager' (ea8137c0-dc5d-4489-85ed-11531f98411c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:30:30 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-4b246c38-47b3-44cb-847a-56118c15ec7a tempest-VolumesCloneTest-163388102 None] Created volume successfully. Nov 06 14:30:31 devstack sudo[92331]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9f8b84f-b5a8-4233-969f-37549457af03 1073741824" returned: 0 in 0.434s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9f8b84f-b5a8-4233-969f-37549457af03 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:31 devstack sudo[92336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9f8b84f-b5a8-4233-969f-37549457af03 Nov 06 14:30:31 devstack sudo[92336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:31 devstack sudo[92336]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9f8b84f-b5a8-4233-969f-37549457af03" returned: 0 in 0.260s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:31 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:30:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:31 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc3c186-f893-434a-9acd-1ba9b55b52d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9f8b84f-b5a8-4233-969f-37549457af03', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:31 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb4fe09-32ed-48e8-bb1e-7bc0e5fa12cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:31 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Volume volume-e9f8b84f-b5a8-4233-969f-37549457af03 (e9f8b84f-b5a8-4233-969f-37549457af03): created successfully Nov 06 14:30:31 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb4fe09-32ed-48e8-bb1e-7bc0e5fa12cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:31 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Flow 'volume_create_manager' (642115c6-eec1-4c8e-9a6d-4677914950c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:30:31 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-4e6ddcef-acb8-42f4-8d84-260bc7b034ae tempest-VolumesTransfersV355Test-755630343 None] Created volume successfully. Nov 06 14:30:31 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c08f874d-0fa3-4032-b32b-7056e50b8485 tempest-VolumesCloneTest-163388102 None] Acquiring lock "cinder-c481d146-4e16-41f4-b19d-0f37ffddf7ba-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:30:31 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c08f874d-0fa3-4032-b32b-7056e50b8485 tempest-VolumesCloneTest-163388102 None] Lock "cinder-c481d146-4e16-41f4-b19d-0f37ffddf7ba-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:30:31 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c08f874d-0fa3-4032-b32b-7056e50b8485 tempest-VolumesCloneTest-163388102 None] Acquiring lock "cinder-quobyte-c481d146-4e16-41f4-b19d-0f37ffddf7ba" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:30:32 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c08f874d-0fa3-4032-b32b-7056e50b8485 tempest-VolumesCloneTest-163388102 None] Lock "cinder-quobyte-c481d146-4e16-41f4-b19d-0f37ffddf7ba" acquired by "delete_volume" :: waited 0.019s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:30:32 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fe3a7b-43be-4fc5-ad22-751e9a333419]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:30:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c08f874d-0fa3-4032-b32b-7056e50b8485 tempest-VolumesCloneTest-163388102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c481d146-4e16-41f4-b19d-0f37ffddf7ba {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:32 devstack sudo[92339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c481d146-4e16-41f4-b19d-0f37ffddf7ba Nov 06 14:30:32 devstack sudo[92339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:32 devstack sudo[92339]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c08f874d-0fa3-4032-b32b-7056e50b8485 tempest-VolumesCloneTest-163388102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c481d146-4e16-41f4-b19d-0f37ffddf7ba" returned: 0 in 0.382s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c08f874d-0fa3-4032-b32b-7056e50b8485 tempest-VolumesCloneTest-163388102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c481d146-4e16-41f4-b19d-0f37ffddf7ba {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:32 devstack sudo[92345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c481d146-4e16-41f4-b19d-0f37ffddf7ba Nov 06 14:30:32 devstack sudo[92345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:32 devstack sudo[92345]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c08f874d-0fa3-4032-b32b-7056e50b8485 tempest-VolumesCloneTest-163388102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c481d146-4e16-41f4-b19d-0f37ffddf7ba" returned: 0 in 0.252s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:32 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c08f874d-0fa3-4032-b32b-7056e50b8485 tempest-VolumesCloneTest-163388102 None] Lock "cinder-quobyte-c481d146-4e16-41f4-b19d-0f37ffddf7ba" released by "delete_volume" :: held 0.679s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:30:32 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-c08f874d-0fa3-4032-b32b-7056e50b8485 tempest-VolumesCloneTest-163388102 None] Created reservations ['b5677130-1a4d-4613-99c8-144946839c69', 'f787a8c7-beeb-44ce-9154-b1a8e5590244', '3c30ce83-8c56-4add-9bf1-380b77c4c868', 'cb56594e-ee7f-4242-af19-2182211f0d35'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:30:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c08f874d-0fa3-4032-b32b-7056e50b8485 tempest-VolumesCloneTest-163388102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c08f874d-0fa3-4032-b32b-7056e50b8485 tempest-VolumesCloneTest-163388102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:32 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c08f874d-0fa3-4032-b32b-7056e50b8485 tempest-VolumesCloneTest-163388102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:30:32 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c08f874d-0fa3-4032-b32b-7056e50b8485 tempest-VolumesCloneTest-163388102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:30:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c08f874d-0fa3-4032-b32b-7056e50b8485 tempest-VolumesCloneTest-163388102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c08f874d-0fa3-4032-b32b-7056e50b8485 tempest-VolumesCloneTest-163388102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:32 devstack sudo[92348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:30:32 devstack sudo[92348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:32 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-63925e25-9258-4155-aebc-ef0e2aa9c253 tempest-VolumesTransfersV355Test-1275170717 None] Acquiring lock "cinder-e9f8b84f-b5a8-4233-969f-37549457af03-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:30:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-63925e25-9258-4155-aebc-ef0e2aa9c253 tempest-VolumesTransfersV355Test-1275170717 None] Lock "cinder-e9f8b84f-b5a8-4233-969f-37549457af03-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:30:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-63925e25-9258-4155-aebc-ef0e2aa9c253 tempest-VolumesTransfersV355Test-1275170717 None] Acquiring lock "cinder-quobyte-e9f8b84f-b5a8-4233-969f-37549457af03" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:30:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-63925e25-9258-4155-aebc-ef0e2aa9c253 tempest-VolumesTransfersV355Test-1275170717 None] Lock "cinder-quobyte-e9f8b84f-b5a8-4233-969f-37549457af03" acquired by "delete_volume" :: waited 0.024s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:30:33 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1fae25-49b0-431d-b95d-bd2ef89b4074]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:30:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-63925e25-9258-4155-aebc-ef0e2aa9c253 tempest-VolumesTransfersV355Test-1275170717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9f8b84f-b5a8-4233-969f-37549457af03 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:33 devstack sudo[92348]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c08f874d-0fa3-4032-b32b-7056e50b8485 tempest-VolumesCloneTest-163388102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.353s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:33 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-c08f874d-0fa3-4032-b32b-7056e50b8485 tempest-VolumesCloneTest-163388102 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:30:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8c165340-ba52-41ce-af9f-725d2ca24b26 tempest-VolumesCloneTest-163388102 None] Acquiring lock "cinder-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:30:33 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-c08f874d-0fa3-4032-b32b-7056e50b8485 tempest-VolumesCloneTest-163388102 None] Deleted volume successfully. Nov 06 14:30:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8c165340-ba52-41ce-af9f-725d2ca24b26 tempest-VolumesCloneTest-163388102 None] Lock "cinder-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:30:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c08f874d-0fa3-4032-b32b-7056e50b8485 tempest-VolumesCloneTest-163388102 None] Lock "cinder-c481d146-4e16-41f4-b19d-0f37ffddf7ba-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:30:33 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=78,cinder:INSERT=23,cinder:UPDATE=102,cinder:DELETE=6 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:30:33 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=78,cinder:INSERT=20,cinder:UPDATE=86,cinder:DELETE=10 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:30:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8c165340-ba52-41ce-af9f-725d2ca24b26 tempest-VolumesCloneTest-163388102 None] Acquiring lock "cinder-quobyte-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:30:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8c165340-ba52-41ce-af9f-725d2ca24b26 tempest-VolumesCloneTest-163388102 None] Lock "cinder-quobyte-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4" acquired by "delete_volume" :: waited 0.018s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:30:33 devstack sudo[92351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9f8b84f-b5a8-4233-969f-37549457af03 Nov 06 14:30:33 devstack sudo[92351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:33 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[4214b0db-081e-4a87-ba02-4b3231f2288f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:30:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8c165340-ba52-41ce-af9f-725d2ca24b26 tempest-VolumesCloneTest-163388102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:33 devstack sudo[92353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4 Nov 06 14:30:33 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:33 devstack sudo[92351]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-63925e25-9258-4155-aebc-ef0e2aa9c253 tempest-VolumesTransfersV355Test-1275170717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9f8b84f-b5a8-4233-969f-37549457af03" returned: 0 in 0.446s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-63925e25-9258-4155-aebc-ef0e2aa9c253 tempest-VolumesTransfersV355Test-1275170717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9f8b84f-b5a8-4233-969f-37549457af03 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:33 devstack sudo[92362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9f8b84f-b5a8-4233-969f-37549457af03 Nov 06 14:30:33 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:33 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8c165340-ba52-41ce-af9f-725d2ca24b26 tempest-VolumesCloneTest-163388102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4" returned: 0 in 0.386s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8c165340-ba52-41ce-af9f-725d2ca24b26 tempest-VolumesCloneTest-163388102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:33 devstack sudo[92367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4 Nov 06 14:30:33 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:33 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-63925e25-9258-4155-aebc-ef0e2aa9c253 tempest-VolumesTransfersV355Test-1275170717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9f8b84f-b5a8-4233-969f-37549457af03" returned: 0 in 0.272s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-63925e25-9258-4155-aebc-ef0e2aa9c253 tempest-VolumesTransfersV355Test-1275170717 None] Lock "cinder-quobyte-e9f8b84f-b5a8-4233-969f-37549457af03" released by "delete_volume" :: held 0.790s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:30:33 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-63925e25-9258-4155-aebc-ef0e2aa9c253 tempest-VolumesTransfersV355Test-1275170717 None] Created reservations ['ed5f0cd5-eef5-4b37-9618-cca11cf53f28', '66d7ce25-373d-41e3-bae8-d0c45d0481c1', 'aef3378b-2bd9-426e-b0b2-a9c09cd6f6cc', 'b75a8841-272f-471b-9cc3-83350d4de401'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:30:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-63925e25-9258-4155-aebc-ef0e2aa9c253 tempest-VolumesTransfersV355Test-1275170717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-63925e25-9258-4155-aebc-ef0e2aa9c253 tempest-VolumesTransfersV355Test-1275170717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:34 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-63925e25-9258-4155-aebc-ef0e2aa9c253 tempest-VolumesTransfersV355Test-1275170717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:30:34 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:34 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-63925e25-9258-4155-aebc-ef0e2aa9c253 tempest-VolumesTransfersV355Test-1275170717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:30:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-63925e25-9258-4155-aebc-ef0e2aa9c253 tempest-VolumesTransfersV355Test-1275170717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-63925e25-9258-4155-aebc-ef0e2aa9c253 tempest-VolumesTransfersV355Test-1275170717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8c165340-ba52-41ce-af9f-725d2ca24b26 tempest-VolumesCloneTest-163388102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4" returned: 0 in 0.268s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:34 devstack sudo[92371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:30:34 devstack sudo[92371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:34 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8c165340-ba52-41ce-af9f-725d2ca24b26 tempest-VolumesCloneTest-163388102 None] Lock "cinder-quobyte-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4" released by "delete_volume" :: held 0.725s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:30:34 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-8c165340-ba52-41ce-af9f-725d2ca24b26 tempest-VolumesCloneTest-163388102 None] Created reservations ['7277021b-4e71-495d-b17e-8813bba93974', 'e60a2ffe-379a-449f-acd4-a5f72ecbc7fe', '48c8e532-4ca1-4b27-a5ee-8c9e17afc69f', 'd3f663d6-d6e9-4d88-946f-6f57c420cd43'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:30:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8c165340-ba52-41ce-af9f-725d2ca24b26 tempest-VolumesCloneTest-163388102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8c165340-ba52-41ce-af9f-725d2ca24b26 tempest-VolumesCloneTest-163388102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:34 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8c165340-ba52-41ce-af9f-725d2ca24b26 tempest-VolumesCloneTest-163388102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:30:34 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8c165340-ba52-41ce-af9f-725d2ca24b26 tempest-VolumesCloneTest-163388102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:30:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8c165340-ba52-41ce-af9f-725d2ca24b26 tempest-VolumesCloneTest-163388102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8c165340-ba52-41ce-af9f-725d2ca24b26 tempest-VolumesCloneTest-163388102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:34 devstack sudo[92373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:30:34 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:34 devstack sudo[92371]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-63925e25-9258-4155-aebc-ef0e2aa9c253 tempest-VolumesTransfersV355Test-1275170717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.252s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:34 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-63925e25-9258-4155-aebc-ef0e2aa9c253 tempest-VolumesTransfersV355Test-1275170717 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:30:34 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-63925e25-9258-4155-aebc-ef0e2aa9c253 tempest-VolumesTransfersV355Test-1275170717 None] Deleted volume successfully. Nov 06 14:30:34 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-63925e25-9258-4155-aebc-ef0e2aa9c253 tempest-VolumesTransfersV355Test-1275170717 None] Lock "cinder-e9f8b84f-b5a8-4233-969f-37549457af03-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:30:34 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8c165340-ba52-41ce-af9f-725d2ca24b26 tempest-VolumesCloneTest-163388102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.272s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:34 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-8c165340-ba52-41ce-af9f-725d2ca24b26 tempest-VolumesCloneTest-163388102 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:30:34 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-8c165340-ba52-41ce-af9f-725d2ca24b26 tempest-VolumesCloneTest-163388102 None] Deleted volume successfully. Nov 06 14:30:34 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8c165340-ba52-41ce-af9f-725d2ca24b26 tempest-VolumesCloneTest-163388102 None] Lock "cinder-cd6dfa9b-d76e-4cc1-9258-5fe36b21ddd4-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:30:37 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-c90455fe-75b3-40da-b600-d81aa3256c86 req-72bcf67d-f20f-4065-8fd6-8a544f7f680b tempest-ServerActionsTestOtherA-1610590813 None] Terminate volume connection completed successfully. Nov 06 14:30:37 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-c90455fe-75b3-40da-b600-d81aa3256c86 req-72bcf67d-f20f-4065-8fd6-8a544f7f680b tempest-ServerActionsTestOtherA-1610590813 None] Deleting attachment 83a434c1-e77e-4e63-9779-e8984517ab28. {{(pid=86854) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 14:30:39 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:30:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Flow 'volume_create_manager' (d19820d8-ef01-4034-996b-fedfa335ce84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:30:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b61b94-88f3-4793-83df-eb05c753bc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b61b94-88f3-4793-83df-eb05c753bc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2006445930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c17ef82-1aee-47ff-af66-8d08e810cf4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a012c3daf6d244549422ab24fe777db5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:30:40Z,use_quota=True,user_id='56f4c4219e0a4aadbd6df5d4de870509',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (613eeef7-45fb-431a-b57b-39895f89380c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (613eeef7-45fb-431a-b57b-39895f89380c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67aaa1c2-099f-47c8-9ac7-53c14784c8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:39 devstack cinder-volume[86854]: DEBUG cinder.image.glance [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Creating Keystone auth plugin from conf {{(pid=86854) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 14:30:40 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67aaa1c2-099f-47c8-9ac7-53c14784c8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8c17ef82-1aee-47ff-af66-8d08e810cf4e', 'volume_name': 'volume-8c17ef82-1aee-47ff-af66-8d08e810cf4e', 'volume_size': 1, 'image_id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15767f46df214a0b8fce21735120de72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'created_at': datetime.datetime(2026, 11, 6, 13, 20, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 20, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0e99-e622-4342-8eb8-14122332c9ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:40 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46099d3a-52a9-4663-98d8-b645ce02f2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:40 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46099d3a-52a9-4663-98d8-b645ce02f2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:40 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0271e018-5c91-4e18-883b-2caa0da9f83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:40 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Volume 8c17ef82-1aee-47ff-af66-8d08e810cf4e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8c17ef82-1aee-47ff-af66-8d08e810cf4e', 'volume_size': 1, 'image_id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15767f46df214a0b8fce21735120de72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'created_at': datetime.datetime(2026, 11, 6, 13, 20, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 20, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0e99-e622-4342-8eb8-14122332c9ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 14:30:40 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Trying to clone 8c17ef82-1aee-47ff-af66-8d08e810cf4e from image 918d0e99-e622-4342-8eb8-14122332c9ca at location (None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}]). {{(pid=86854) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 14:30:41 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_a9ajfx8gdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 14:30:41 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Image download 20.69 MB at 20.69 MB/s Nov 06 14:30:41 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df23774-178a-4368-be83-b42836d455bc]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:30:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_a9ajfx8gdevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:41 devstack sudo[92432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_a9ajfx8gdevstack@QuobyteHD Nov 06 14:30:41 devstack sudo[92432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:41 devstack sudo[92432]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_a9ajfx8gdevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:41 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Temporary image 918d0e99-e622-4342-8eb8-14122332c9ca is fetched for user 56f4c4219e0a4aadbd6df5d4de870509. {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 14:30:41 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[678a8c80-d153-459d-9c78-978efe5cd11c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:30:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_a9ajfx8gdevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:42 devstack sudo[92438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_a9ajfx8gdevstack@QuobyteHD Nov 06 14:30:42 devstack sudo[92438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:42 devstack sudo[92438]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_a9ajfx8gdevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:42 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2006445930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c17ef82-1aee-47ff-af66-8d08e810cf4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a012c3daf6d244549422ab24fe777db5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:30:40Z,use_quota=True,user_id='56f4c4219e0a4aadbd6df5d4de870509',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:30:42 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Creating volume 8c17ef82-1aee-47ff-af66-8d08e810cf4e {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:30:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:42 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:30:42 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:30:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:42 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:30:42 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:30:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8c17ef82-1aee-47ff-af66-8d08e810cf4e 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:42 devstack sudo[92443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8c17ef82-1aee-47ff-af66-8d08e810cf4e 1073741824 Nov 06 14:30:42 devstack sudo[92443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:42 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:30:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Flow 'volume_create_manager' (7574cd4a-6296-4ff3-a990-391cdbb7b6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:30:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba5802fb-3729-467f-a19f-1fc5ddc1643e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba5802fb-3729-467f-a19f-1fc5ddc1643e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-74089672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e37961-8d59-4123-b110-186867cf2c3b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c5b41a109b9948f38e79f5045bfeaff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:30:43Z,use_quota=True,user_id='e031a83127bc436292b7adc80dc15ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48f400c4-f89d-4a41-a068-2aec7e8ffd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48f400c4-f89d-4a41-a068-2aec7e8ffd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e8cf60-ae30-405a-991f-1a33923acf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e8cf60-ae30-405a-991f-1a33923acf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28e37961-8d59-4123-b110-186867cf2c3b', 'volume_name': 'volume-28e37961-8d59-4123-b110-186867cf2c3b', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f4b306f-0597-4de5-9147-ce7f0d9a8abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f4b306f-0597-4de5-9147-ce7f0d9a8abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1829673c-951a-45f4-a72d-79b4b1767b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:42 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Volume 28e37961-8d59-4123-b110-186867cf2c3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28e37961-8d59-4123-b110-186867cf2c3b', 'volume_size': 1} Nov 06 14:30:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:42 devstack sudo[92443]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8c17ef82-1aee-47ff-af66-8d08e810cf4e 1073741824" returned: 0 in 0.496s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8c17ef82-1aee-47ff-af66-8d08e810cf4e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:42 devstack sudo[92449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8c17ef82-1aee-47ff-af66-8d08e810cf4e Nov 06 14:30:42 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:43 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8c17ef82-1aee-47ff-af66-8d08e810cf4e" returned: 0 in 0.268s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:30:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.571s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-74089672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e37961-8d59-4123-b110-186867cf2c3b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c5b41a109b9948f38e79f5045bfeaff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:30:43Z,use_quota=True,user_id='e031a83127bc436292b7adc80dc15ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:30:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Creating volume 28e37961-8d59-4123-b110-186867cf2c3b {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:30:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:30:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:30:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:30:43 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:30:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-28e37961-8d59-4123-b110-186867cf2c3b 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:43 devstack sudo[92452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-28e37961-8d59-4123-b110-186867cf2c3b 1073741824 Nov 06 14:30:43 devstack sudo[92452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:43 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Attempting download of 918d0e99-e622-4342-8eb8-14122332c9ca ((None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}])) to volume 8c17ef82-1aee-47ff-af66-8d08e810cf4e. {{(pid=86854) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 14:30:43 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[039bf07b-df34-4b6f-9736-036daf844cad]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:30:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_rrfe3cgb {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:43 devstack sudo[92454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_rrfe3cgb Nov 06 14:30:43 devstack sudo[92454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:43 devstack sudo[92454]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_rrfe3cgb" returned: 0 in 0.399s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_rrfe3cgb {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:43 devstack sudo[92452]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-28e37961-8d59-4123-b110-186867cf2c3b 1073741824" returned: 0 in 0.566s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-28e37961-8d59-4123-b110-186867cf2c3b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:43 devstack sudo[92464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_rrfe3cgb Nov 06 14:30:43 devstack sudo[92464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:43 devstack sudo[92466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-28e37961-8d59-4123-b110-186867cf2c3b Nov 06 14:30:43 devstack sudo[92466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:44 devstack sudo[92464]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_rrfe3cgb" returned: 1 in 0.471s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_rrfe3cgb' failed. Not Retrying. {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 14:30:44 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[07600fdd-7e2a-493b-bc4a-2b8c5fdeb603]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:30:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_a9ajfx8gdevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:44 devstack sudo[92466]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-28e37961-8d59-4123-b110-186867cf2c3b" returned: 0 in 0.394s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:30:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1829673c-951a-45f4-a72d-79b4b1767b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28e37961-8d59-4123-b110-186867cf2c3b', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57a7793-ac46-4a3c-a6e5-09a322afda05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:44 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Volume volume-28e37961-8d59-4123-b110-186867cf2c3b (28e37961-8d59-4123-b110-186867cf2c3b): created successfully Nov 06 14:30:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57a7793-ac46-4a3c-a6e5-09a322afda05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Flow 'volume_create_manager' (7574cd4a-6296-4ff3-a990-391cdbb7b6bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:30:44 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-da66c44c-f32f-4874-9cd4-e89281ed28e5 tempest-VolumesListTestJSON-1317415653 None] Created volume successfully. Nov 06 14:30:44 devstack sudo[92473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_a9ajfx8gdevstack@QuobyteHD Nov 06 14:30:44 devstack sudo[92473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:44 devstack sudo[92473]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_a9ajfx8gdevstack@QuobyteHD" returned: 0 in 0.547s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:44 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] 918d0e99-e622-4342-8eb8-14122332c9ca was qcow2, converting to qcow2 {{(pid=86854) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 14:30:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_a9ajfx8gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8c17ef82-1aee-47ff-af66-8d08e810cf4e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:44 devstack sudo[92498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_a9ajfx8gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8c17ef82-1aee-47ff-af66-8d08e810cf4e Nov 06 14:30:44 devstack sudo[92498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:44 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Flow 'volume_create_manager' (f3ec6bb5-dcf9-4f45-9998-92411a1a9fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e4516c-3a3c-492f-a1af-fe4b3bd00a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e4516c-3a3c-492f-a1af-fe4b3bd00a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1901712417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d497f6-f98c-443f-8535-9398feb12a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d96214a54de244d890f6dd463e905c69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:30:45Z,use_quota=True,user_id='f7b945d7977b467c8766928a2f6f95ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0482d84c-daea-4ce0-8953-5d4054f97e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0482d84c-daea-4ce0-8953-5d4054f97e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (743406fd-3414-4125-b284-d0e4a650fcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG cinder.image.glance [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Creating Keystone auth plugin from conf {{(pid=86854) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Flow 'volume_create_manager' (fc8565da-85c0-4de6-be32-70a3e33d2c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660f5c63-d95a-4ce9-ba9e-7c79e69baf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (743406fd-3414-4125-b284-d0e4a650fcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e7d497f6-f98c-443f-8535-9398feb12a27', 'volume_name': 'volume-e7d497f6-f98c-443f-8535-9398feb12a27', 'volume_size': 1, 'image_id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15767f46df214a0b8fce21735120de72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'created_at': datetime.datetime(2026, 11, 6, 13, 20, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 20, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0e99-e622-4342-8eb8-14122332c9ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76a54a8-5a22-40fa-b25a-054f05ef485a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76a54a8-5a22-40fa-b25a-054f05ef485a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0079b10a-92bd-4eac-8f62-450db33f1d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:45 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Volume e7d497f6-f98c-443f-8535-9398feb12a27: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e7d497f6-f98c-443f-8535-9398feb12a27', 'volume_size': 1, 'image_id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15767f46df214a0b8fce21735120de72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'created_at': datetime.datetime(2026, 11, 6, 13, 20, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 20, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0e99-e622-4342-8eb8-14122332c9ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Trying to clone e7d497f6-f98c-443f-8535-9398feb12a27 from image 918d0e99-e622-4342-8eb8-14122332c9ca at location (None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}]). {{(pid=86854) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660f5c63-d95a-4ce9-ba9e-7c79e69baf06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1645527676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea01c08c-7354-4fba-9611-5344738af057,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c5b41a109b9948f38e79f5045bfeaff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:30:45Z,use_quota=True,user_id='e031a83127bc436292b7adc80dc15ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e64e3196-c7d0-4ad5-92ca-38cd1d6a4a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e64e3196-c7d0-4ad5-92ca-38cd1d6a4a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94083726-abfe-4be2-afaa-b9d517f07b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94083726-abfe-4be2-afaa-b9d517f07b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea01c08c-7354-4fba-9611-5344738af057', 'volume_name': 'volume-ea01c08c-7354-4fba-9611-5344738af057', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f8881b-5351-4df7-b79e-17a2a1663e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f8881b-5351-4df7-b79e-17a2a1663e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffdd7a5c-16d0-421c-ba3c-2a1471e67f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:45 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Volume ea01c08c-7354-4fba-9611-5344738af057: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea01c08c-7354-4fba-9611-5344738af057', 'volume_size': 1} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1645527676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea01c08c-7354-4fba-9611-5344738af057,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c5b41a109b9948f38e79f5045bfeaff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:30:45Z,use_quota=True,user_id='e031a83127bc436292b7adc80dc15ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Creating volume ea01c08c-7354-4fba-9611-5344738af057 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:30:45 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:30:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ea01c08c-7354-4fba-9611-5344738af057 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:45 devstack sudo[92511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ea01c08c-7354-4fba-9611-5344738af057 1073741824 Nov 06 14:30:45 devstack sudo[92511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:46 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_csehkdiodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 14:30:46 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Image download 20.69 MB at 20.69 MB/s Nov 06 14:30:46 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2b0449-074c-4874-8099-309f1e7efc81]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:30:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_csehkdiodevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:46 devstack sudo[92517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_csehkdiodevstack@QuobyteHD Nov 06 14:30:46 devstack sudo[92517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:46 devstack sudo[92511]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ea01c08c-7354-4fba-9611-5344738af057 1073741824" returned: 0 in 0.763s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ea01c08c-7354-4fba-9611-5344738af057 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:46 devstack sudo[92521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ea01c08c-7354-4fba-9611-5344738af057 Nov 06 14:30:46 devstack sudo[92521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:46 devstack sudo[92517]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_csehkdiodevstack@QuobyteHD" returned: 0 in 0.508s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:46 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Temporary image 918d0e99-e622-4342-8eb8-14122332c9ca is fetched for user f7b945d7977b467c8766928a2f6f95ae. {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 14:30:46 devstack sudo[92521]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ea01c08c-7354-4fba-9611-5344738af057" returned: 0 in 0.319s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:46 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:30:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:46 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffdd7a5c-16d0-421c-ba3c-2a1471e67f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea01c08c-7354-4fba-9611-5344738af057', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:46 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade6dc28-949e-4f06-85b4-86c085f5075e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:46 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[904ac420-673c-4b2f-95eb-bcc4926be24d]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:30:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_csehkdiodevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:46 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Volume volume-ea01c08c-7354-4fba-9611-5344738af057 (ea01c08c-7354-4fba-9611-5344738af057): created successfully Nov 06 14:30:46 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade6dc28-949e-4f06-85b4-86c085f5075e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:46 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Flow 'volume_create_manager' (fc8565da-85c0-4de6-be32-70a3e33d2c70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:30:46 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-cc40981a-8657-4015-8cd8-422e687ba0f4 tempest-VolumesListTestJSON-1317415653 None] Created volume successfully. Nov 06 14:30:47 devstack sudo[92527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_csehkdiodevstack@QuobyteHD Nov 06 14:30:47 devstack sudo[92527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:47 devstack sudo[92527]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_csehkdiodevstack@QuobyteHD" returned: 0 in 0.519s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:47 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1901712417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d497f6-f98c-443f-8535-9398feb12a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d96214a54de244d890f6dd463e905c69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:30:45Z,use_quota=True,user_id='f7b945d7977b467c8766928a2f6f95ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:30:47 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Creating volume e7d497f6-f98c-443f-8535-9398feb12a27 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:30:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:47 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:30:47 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:30:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:47 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:30:47 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:30:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e7d497f6-f98c-443f-8535-9398feb12a27 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:47 devstack sudo[92532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e7d497f6-f98c-443f-8535-9398feb12a27 1073741824 Nov 06 14:30:47 devstack sudo[92532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:47 devstack sudo[92498]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_a9ajfx8gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8c17ef82-1aee-47ff-af66-8d08e810cf4e" returned: 0 in 2.891s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:47 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_a9ajfx8gdevstack@QuobyteHD, size 112.00 MB, duration 2.89 sec, destination /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8c17ef82-1aee-47ff-af66-8d08e810cf4e {{(pid=86854) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 14:30:47 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Converted 112.00 MB image at 38.72 MB/s Nov 06 14:30:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8c17ef82-1aee-47ff-af66-8d08e810cf4e 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:47 devstack sudo[92537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8c17ef82-1aee-47ff-af66-8d08e810cf4e 1G Nov 06 14:30:47 devstack sudo[92537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:47 devstack sudo[92532]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e7d497f6-f98c-443f-8535-9398feb12a27 1073741824" returned: 0 in 0.462s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e7d497f6-f98c-443f-8535-9398feb12a27 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:47 devstack sudo[92542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e7d497f6-f98c-443f-8535-9398feb12a27 Nov 06 14:30:47 devstack sudo[92542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:48 devstack sudo[92537]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8c17ef82-1aee-47ff-af66-8d08e810cf4e 1G" returned: 0 in 0.419s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Downloaded image 918d0e99-e622-4342-8eb8-14122332c9ca ((None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}])) to volume 8c17ef82-1aee-47ff-af66-8d08e810cf4e successfully. {{(pid=86854) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Temporary image 918d0e99-e622-4342-8eb8-14122332c9ca for user 56f4c4219e0a4aadbd6df5d4de870509 is deleted. {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Marking volume 8c17ef82-1aee-47ff-af66-8d08e810cf4e as bootable. {{(pid=86854) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Copying metadata from image 918d0e99-e622-4342-8eb8-14122332c9ca to 8c17ef82-1aee-47ff-af66-8d08e810cf4e. {{(pid=86854) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Creating volume glance metadata for volume 8c17ef82-1aee-47ff-af66-8d08e810cf4e backed by image 918d0e99-e622-4342-8eb8-14122332c9ca with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86854) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0271e018-5c91-4e18-883b-2caa0da9f83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c17ef82-1aee-47ff-af66-8d08e810cf4e', 'volume_size': 1, 'image_id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15767f46df214a0b8fce21735120de72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'created_at': datetime.datetime(2026, 11, 6, 13, 20, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 20, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0e99-e622-4342-8eb8-14122332c9ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb2129d-c9da-42d1-886b-000e86afa10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:48 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Volume volume-8c17ef82-1aee-47ff-af66-8d08e810cf4e (8c17ef82-1aee-47ff-af66-8d08e810cf4e): created successfully Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb2129d-c9da-42d1-886b-000e86afa10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:48 devstack sudo[92542]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Flow 'volume_create_manager' (d19820d8-ef01-4034-996b-fedfa335ce84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Flow 'volume_create_manager' (b6647e36-bc7c-41de-b3c2-1476dcfab725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a49939-556e-4f9f-8ea3-a3245393ee89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e7d497f6-f98c-443f-8535-9398feb12a27" returned: 0 in 0.414s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:48 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-5590490c-9867-4ffe-91c7-7d85f93e7755 tempest-VolumesExtendTest-1683989370 None] Created volume successfully. Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a49939-556e-4f9f-8ea3-a3245393ee89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-344036987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31507b58-50ab-46f7-ab00-091fec434837,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c5b41a109b9948f38e79f5045bfeaff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:30:48Z,use_quota=True,user_id='e031a83127bc436292b7adc80dc15ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50fd170c-a16c-4137-aca7-2e08b1a521b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50fd170c-a16c-4137-aca7-2e08b1a521b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e79504e1-8ff8-4c02-82a5-06e9e3f2abab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e79504e1-8ff8-4c02-82a5-06e9e3f2abab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31507b58-50ab-46f7-ab00-091fec434837', 'volume_name': 'volume-31507b58-50ab-46f7-ab00-091fec434837', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6302e7bb-bda8-4e31-91c4-af055d8eb598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6302e7bb-bda8-4e31-91c4-af055d8eb598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62b0112-8d8d-41bf-94de-f5ce4259ce0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:48 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Volume 31507b58-50ab-46f7-ab00-091fec434837: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31507b58-50ab-46f7-ab00-091fec434837', 'volume_size': 1} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-344036987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31507b58-50ab-46f7-ab00-091fec434837,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c5b41a109b9948f38e79f5045bfeaff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:30:48Z,use_quota=True,user_id='e031a83127bc436292b7adc80dc15ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Creating volume 31507b58-50ab-46f7-ab00-091fec434837 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:30:48 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-31507b58-50ab-46f7-ab00-091fec434837 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Attempting download of 918d0e99-e622-4342-8eb8-14122332c9ca ((None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}])) to volume e7d497f6-f98c-443f-8535-9398feb12a27. {{(pid=86854) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 14:30:48 devstack sudo[92546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-31507b58-50ab-46f7-ab00-091fec434837 1073741824 Nov 06 14:30:48 devstack sudo[92546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb80089d-6283-44af-b777-d5accae82132]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_lsfcczsr {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:48 devstack sudo[92548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_lsfcczsr Nov 06 14:30:48 devstack sudo[92548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f0bc4d01-e3f7-431e-956a-1bfae1ee4668 tempest-VolumesExtendTest-1683989370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:48 devstack sudo[92548]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_lsfcczsr" returned: 0 in 0.369s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_lsfcczsr {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:48 devstack sudo[92546]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-31507b58-50ab-46f7-ab00-091fec434837 1073741824" returned: 0 in 0.571s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-31507b58-50ab-46f7-ab00-091fec434837 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:49 devstack sudo[92555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_lsfcczsr Nov 06 14:30:49 devstack sudo[92555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:49 devstack sudo[92556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-31507b58-50ab-46f7-ab00-091fec434837 Nov 06 14:30:49 devstack sudo[92556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b74afc61-0991-4535-b3db-364b57e22809 tempest-AttachVolumeShelveTestJSON-1214937209 None] Acquiring lock "cinder-86ce7c33-b3b1-458e-8a7f-f2ee71ad951b-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b74afc61-0991-4535-b3db-364b57e22809 tempest-AttachVolumeShelveTestJSON-1214937209 None] Lock "cinder-86ce7c33-b3b1-458e-8a7f-f2ee71ad951b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:30:49 devstack sudo[92555]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_lsfcczsr" returned: 1 in 0.396s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_lsfcczsr' failed. Not Retrying. {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4ad946-df61-440c-969b-673495474ce2]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_csehkdiodevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:49 devstack sudo[92556]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b74afc61-0991-4535-b3db-364b57e22809 tempest-AttachVolumeShelveTestJSON-1214937209 None] Acquiring lock "cinder-quobyte-86ce7c33-b3b1-458e-8a7f-f2ee71ad951b" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-31507b58-50ab-46f7-ab00-091fec434837" returned: 0 in 0.324s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f0bc4d01-e3f7-431e-956a-1bfae1ee4668 tempest-VolumesExtendTest-1683989370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.599s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b74afc61-0991-4535-b3db-364b57e22809 tempest-AttachVolumeShelveTestJSON-1214937209 None] Lock "cinder-quobyte-86ce7c33-b3b1-458e-8a7f-f2ee71ad951b" acquired by "delete_volume" :: waited 0.022s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66bd53a-c411-4b4f-897e-7445d0385cee]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62b0112-8d8d-41bf-94de-f5ce4259ce0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31507b58-50ab-46f7-ab00-091fec434837', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303c1fef-80d0-440a-bd0b-95107dfe2248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f0bc4d01-e3f7-431e-956a-1bfae1ee4668 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8c17ef82-1aee-47ff-af66-8d08e810cf4e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba30c99-ee8b-4436-84b9-950e92347589]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b74afc61-0991-4535-b3db-364b57e22809 tempest-AttachVolumeShelveTestJSON-1214937209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-86ce7c33-b3b1-458e-8a7f-f2ee71ad951b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:49 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Volume volume-31507b58-50ab-46f7-ab00-091fec434837 (31507b58-50ab-46f7-ab00-091fec434837): created successfully Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303c1fef-80d0-440a-bd0b-95107dfe2248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Flow 'volume_create_manager' (b6647e36-bc7c-41de-b3c2-1476dcfab725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:30:49 devstack sudo[92563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_csehkdiodevstack@QuobyteHD Nov 06 14:30:49 devstack sudo[92563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:49 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-2b28e9f7-c6c0-4831-83d3-31cca16eb61d tempest-VolumesListTestJSON-1317415653 None] Created volume successfully. Nov 06 14:30:49 devstack sudo[92564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8c17ef82-1aee-47ff-af66-8d08e810cf4e Nov 06 14:30:49 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:49 devstack sudo[92565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-86ce7c33-b3b1-458e-8a7f-f2ee71ad951b Nov 06 14:30:49 devstack sudo[92565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:49 devstack sudo[92563]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_csehkdiodevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] 918d0e99-e622-4342-8eb8-14122332c9ca was qcow2, converting to qcow2 {{(pid=86854) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_csehkdiodevstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e7d497f6-f98c-443f-8535-9398feb12a27 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:49 devstack sudo[92572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_csehkdiodevstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e7d497f6-f98c-443f-8535-9398feb12a27 Nov 06 14:30:49 devstack sudo[92572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:49 devstack sudo[92565]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:49 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b74afc61-0991-4535-b3db-364b57e22809 tempest-AttachVolumeShelveTestJSON-1214937209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-86ce7c33-b3b1-458e-8a7f-f2ee71ad951b" returned: 0 in 0.377s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b74afc61-0991-4535-b3db-364b57e22809 tempest-AttachVolumeShelveTestJSON-1214937209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-86ce7c33-b3b1-458e-8a7f-f2ee71ad951b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f0bc4d01-e3f7-431e-956a-1bfae1ee4668 tempest-VolumesExtendTest-1683989370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8c17ef82-1aee-47ff-af66-8d08e810cf4e" returned: 0 in 0.402s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f0bc4d01-e3f7-431e-956a-1bfae1ee4668 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8c17ef82-1aee-47ff-af66-8d08e810cf4e 2G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:49 devstack sudo[92580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-86ce7c33-b3b1-458e-8a7f-f2ee71ad951b Nov 06 14:30:49 devstack sudo[92580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f0bc4d01-e3f7-431e-956a-1bfae1ee4668 tempest-VolumesExtendTest-1683989370 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8c17ef82-1aee-47ff-af66-8d08e810cf4e 2G" returned: 0 in 0.136s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f0bc4d01-e3f7-431e-956a-1bfae1ee4668 tempest-VolumesExtendTest-1683989370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.593s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:49 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-f0bc4d01-e3f7-431e-956a-1bfae1ee4668 tempest-VolumesExtendTest-1683989370 None] Extend volume completed successfully. Nov 06 14:30:50 devstack sudo[92580]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b74afc61-0991-4535-b3db-364b57e22809 tempest-AttachVolumeShelveTestJSON-1214937209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-86ce7c33-b3b1-458e-8a7f-f2ee71ad951b" returned: 0 in 0.307s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:50 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b74afc61-0991-4535-b3db-364b57e22809 tempest-AttachVolumeShelveTestJSON-1214937209 None] Lock "cinder-quobyte-86ce7c33-b3b1-458e-8a7f-f2ee71ad951b" released by "delete_volume" :: held 0.741s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:30:50 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-b74afc61-0991-4535-b3db-364b57e22809 tempest-AttachVolumeShelveTestJSON-1214937209 None] Created reservations ['36301d25-b9a4-414c-b2d7-4bb34a9f5d7d', '20ca2512-51c8-4c8b-84fc-533de0a0b5e7', 'abbe5c8e-3809-4725-9fe6-8731f41463fd', '3f368b70-ed17-4874-8b51-b594408e1347'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:30:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b74afc61-0991-4535-b3db-364b57e22809 tempest-AttachVolumeShelveTestJSON-1214937209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b74afc61-0991-4535-b3db-364b57e22809 tempest-AttachVolumeShelveTestJSON-1214937209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:50 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b74afc61-0991-4535-b3db-364b57e22809 tempest-AttachVolumeShelveTestJSON-1214937209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:30:50 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b74afc61-0991-4535-b3db-364b57e22809 tempest-AttachVolumeShelveTestJSON-1214937209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:30:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b74afc61-0991-4535-b3db-364b57e22809 tempest-AttachVolumeShelveTestJSON-1214937209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b74afc61-0991-4535-b3db-364b57e22809 tempest-AttachVolumeShelveTestJSON-1214937209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:50 devstack sudo[92591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:30:50 devstack sudo[92591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:50 devstack sudo[92591]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b74afc61-0991-4535-b3db-364b57e22809 tempest-AttachVolumeShelveTestJSON-1214937209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.271s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:50 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-b74afc61-0991-4535-b3db-364b57e22809 tempest-AttachVolumeShelveTestJSON-1214937209 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:30:50 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-b74afc61-0991-4535-b3db-364b57e22809 tempest-AttachVolumeShelveTestJSON-1214937209 None] Deleted volume successfully. Nov 06 14:30:50 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b74afc61-0991-4535-b3db-364b57e22809 tempest-AttachVolumeShelveTestJSON-1214937209 None] Lock "cinder-86ce7c33-b3b1-458e-8a7f-f2ee71ad951b-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:30:51 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e5ab9a01-4420-41a3-8a6e-ea5321c90ec2 tempest-VolumesExtendTest-1683989370 None] Acquiring lock "cinder-8c17ef82-1aee-47ff-af66-8d08e810cf4e-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:30:51 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e5ab9a01-4420-41a3-8a6e-ea5321c90ec2 tempest-VolumesExtendTest-1683989370 None] Lock "cinder-8c17ef82-1aee-47ff-af66-8d08e810cf4e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:30:51 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e5ab9a01-4420-41a3-8a6e-ea5321c90ec2 tempest-VolumesExtendTest-1683989370 None] Acquiring lock "cinder-quobyte-8c17ef82-1aee-47ff-af66-8d08e810cf4e" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:30:51 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e5ab9a01-4420-41a3-8a6e-ea5321c90ec2 tempest-VolumesExtendTest-1683989370 None] Lock "cinder-quobyte-8c17ef82-1aee-47ff-af66-8d08e810cf4e" acquired by "delete_volume" :: waited 0.028s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:30:51 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[736587a5-c09a-488d-983d-bc0d510d78f8]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:30:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e5ab9a01-4420-41a3-8a6e-ea5321c90ec2 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8c17ef82-1aee-47ff-af66-8d08e810cf4e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:51 devstack sudo[92595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8c17ef82-1aee-47ff-af66-8d08e810cf4e Nov 06 14:30:51 devstack sudo[92595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:52 devstack sudo[92595]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e5ab9a01-4420-41a3-8a6e-ea5321c90ec2 tempest-VolumesExtendTest-1683989370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8c17ef82-1aee-47ff-af66-8d08e810cf4e" returned: 0 in 0.502s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e5ab9a01-4420-41a3-8a6e-ea5321c90ec2 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8c17ef82-1aee-47ff-af66-8d08e810cf4e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:52 devstack sudo[92601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8c17ef82-1aee-47ff-af66-8d08e810cf4e Nov 06 14:30:52 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:52 devstack sudo[92572]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_csehkdiodevstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e7d497f6-f98c-443f-8535-9398feb12a27" returned: 0 in 2.430s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:52 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_csehkdiodevstack@QuobyteHD, size 112.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e7d497f6-f98c-443f-8535-9398feb12a27 {{(pid=86854) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 14:30:52 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Converted 112.00 MB image at 46.06 MB/s Nov 06 14:30:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e7d497f6-f98c-443f-8535-9398feb12a27 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:52 devstack sudo[92603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e7d497f6-f98c-443f-8535-9398feb12a27 1G Nov 06 14:30:52 devstack sudo[92603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:52 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e5ab9a01-4420-41a3-8a6e-ea5321c90ec2 tempest-VolumesExtendTest-1683989370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8c17ef82-1aee-47ff-af66-8d08e810cf4e" returned: 0 in 0.331s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:52 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e5ab9a01-4420-41a3-8a6e-ea5321c90ec2 tempest-VolumesExtendTest-1683989370 None] Lock "cinder-quobyte-8c17ef82-1aee-47ff-af66-8d08e810cf4e" released by "delete_volume" :: held 0.885s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:30:52 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-e5ab9a01-4420-41a3-8a6e-ea5321c90ec2 tempest-VolumesExtendTest-1683989370 None] Created reservations ['0b3fd83d-9c4b-4374-9b6a-3cd8acc3a6e8', '58bebf95-312a-42e5-b491-044604bc2b6d', 'b648899f-6068-4447-9360-3a6b26a62e7c', 'a25752dd-6e06-41e8-bd56-f90bc6a93774'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:30:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e5ab9a01-4420-41a3-8a6e-ea5321c90ec2 tempest-VolumesExtendTest-1683989370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e5ab9a01-4420-41a3-8a6e-ea5321c90ec2 tempest-VolumesExtendTest-1683989370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:52 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e5ab9a01-4420-41a3-8a6e-ea5321c90ec2 tempest-VolumesExtendTest-1683989370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:30:52 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e5ab9a01-4420-41a3-8a6e-ea5321c90ec2 tempest-VolumesExtendTest-1683989370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:30:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e5ab9a01-4420-41a3-8a6e-ea5321c90ec2 tempest-VolumesExtendTest-1683989370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e5ab9a01-4420-41a3-8a6e-ea5321c90ec2 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:52 devstack sudo[92610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:30:52 devstack sudo[92610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:52 devstack sudo[92603]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e7d497f6-f98c-443f-8535-9398feb12a27 1G" returned: 0 in 0.561s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:52 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Downloaded image 918d0e99-e622-4342-8eb8-14122332c9ca ((None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}])) to volume e7d497f6-f98c-443f-8535-9398feb12a27 successfully. {{(pid=86854) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 14:30:52 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Temporary image 918d0e99-e622-4342-8eb8-14122332c9ca for user f7b945d7977b467c8766928a2f6f95ae is deleted. {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 14:30:52 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Marking volume e7d497f6-f98c-443f-8535-9398feb12a27 as bootable. {{(pid=86854) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 14:30:52 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Copying metadata from image 918d0e99-e622-4342-8eb8-14122332c9ca to e7d497f6-f98c-443f-8535-9398feb12a27. {{(pid=86854) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 14:30:52 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Creating volume glance metadata for volume e7d497f6-f98c-443f-8535-9398feb12a27 backed by image 918d0e99-e622-4342-8eb8-14122332c9ca with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86854) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 14:30:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0079b10a-92bd-4eac-8f62-450db33f1d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7d497f6-f98c-443f-8535-9398feb12a27', 'volume_size': 1, 'image_id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15767f46df214a0b8fce21735120de72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'created_at': datetime.datetime(2026, 11, 6, 13, 20, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 20, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0e99-e622-4342-8eb8-14122332c9ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9164def-9b2f-4d4e-9e79-e978b41e6ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:52 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Volume volume-e7d497f6-f98c-443f-8535-9398feb12a27 (e7d497f6-f98c-443f-8535-9398feb12a27): created successfully Nov 06 14:30:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9164def-9b2f-4d4e-9e79-e978b41e6ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Flow 'volume_create_manager' (f3ec6bb5-dcf9-4f45-9998-92411a1a9fb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:30:52 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-913f10aa-32c5-434c-813a-20343aab1d46 tempest-ServerActionsTestOtherA-1610590813 None] Created volume successfully. Nov 06 14:30:52 devstack sudo[92610]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e5ab9a01-4420-41a3-8a6e-ea5321c90ec2 tempest-VolumesExtendTest-1683989370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.414s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:52 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-e5ab9a01-4420-41a3-8a6e-ea5321c90ec2 tempest-VolumesExtendTest-1683989370 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:30:52 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-e5ab9a01-4420-41a3-8a6e-ea5321c90ec2 tempest-VolumesExtendTest-1683989370 None] Deleted volume successfully. Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e5ab9a01-4420-41a3-8a6e-ea5321c90ec2 tempest-VolumesExtendTest-1683989370 None] Lock "cinder-8c17ef82-1aee-47ff-af66-8d08e810cf4e-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ffad75cb-7d2a-4b63-8c33-bbc921313a40 tempest-VolumesListTestJSON-1317415653 None] Acquiring lock "cinder-31507b58-50ab-46f7-ab00-091fec434837-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ffad75cb-7d2a-4b63-8c33-bbc921313a40 tempest-VolumesListTestJSON-1317415653 None] Lock "cinder-31507b58-50ab-46f7-ab00-091fec434837-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ffad75cb-7d2a-4b63-8c33-bbc921313a40 tempest-VolumesListTestJSON-1317415653 None] Acquiring lock "cinder-quobyte-31507b58-50ab-46f7-ab00-091fec434837" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ffad75cb-7d2a-4b63-8c33-bbc921313a40 tempest-VolumesListTestJSON-1317415653 None] Lock "cinder-quobyte-31507b58-50ab-46f7-ab00-091fec434837" acquired by "delete_volume" :: waited 0.022s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0e7f70-1016-4488-8d00-a4e9d517ae0f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ffad75cb-7d2a-4b63-8c33-bbc921313a40 tempest-VolumesListTestJSON-1317415653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-31507b58-50ab-46f7-ab00-091fec434837 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Flow 'volume_create_manager' (0f432ce9-aaf0-4c7c-91ee-ba30fb6b081b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c0506c-57a1-4db1-bb77-9e1c5d3950c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:53 devstack sudo[92613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-31507b58-50ab-46f7-ab00-091fec434837 Nov 06 14:30:53 devstack sudo[92613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c0506c-57a1-4db1-bb77-9e1c5d3950c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-901389526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad954caa-6704-4673-abad-4b771913e613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a012c3daf6d244549422ab24fe777db5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:30:53Z,use_quota=True,user_id='56f4c4219e0a4aadbd6df5d4de870509',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4054c64-a98f-41af-bac3-15112e1bb77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4054c64-a98f-41af-bac3-15112e1bb77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1494ff5-4901-484f-926f-e5508851b6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1494ff5-4901-484f-926f-e5508851b6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad954caa-6704-4673-abad-4b771913e613', 'volume_name': 'volume-ad954caa-6704-4673-abad-4b771913e613', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119a79ef-2d71-49a4-aa49-8666d9710e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119a79ef-2d71-49a4-aa49-8666d9710e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc0f24c-6cba-4735-9988-cd09d6c912b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:53 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Volume ad954caa-6704-4673-abad-4b771913e613: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad954caa-6704-4673-abad-4b771913e613', 'volume_size': 1} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-901389526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad954caa-6704-4673-abad-4b771913e613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a012c3daf6d244549422ab24fe777db5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:30:53Z,use_quota=True,user_id='56f4c4219e0a4aadbd6df5d4de870509',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Creating volume ad954caa-6704-4673-abad-4b771913e613 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:30:53 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:53 devstack sudo[92615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613 1073741824 Nov 06 14:30:53 devstack sudo[92615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:53 devstack sudo[92613]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ffad75cb-7d2a-4b63-8c33-bbc921313a40 tempest-VolumesListTestJSON-1317415653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-31507b58-50ab-46f7-ab00-091fec434837" returned: 0 in 0.407s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ffad75cb-7d2a-4b63-8c33-bbc921313a40 tempest-VolumesListTestJSON-1317415653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-31507b58-50ab-46f7-ab00-091fec434837 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:53 devstack sudo[92620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-31507b58-50ab-46f7-ab00-091fec434837 Nov 06 14:30:53 devstack sudo[92620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:53 devstack sudo[92620]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ffad75cb-7d2a-4b63-8c33-bbc921313a40 tempest-VolumesListTestJSON-1317415653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-31507b58-50ab-46f7-ab00-091fec434837" returned: 0 in 0.340s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ffad75cb-7d2a-4b63-8c33-bbc921313a40 tempest-VolumesListTestJSON-1317415653 None] Lock "cinder-quobyte-31507b58-50ab-46f7-ab00-091fec434837" released by "delete_volume" :: held 0.806s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:30:53 devstack sudo[92615]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613 1073741824" returned: 0 in 0.597s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:54 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-ffad75cb-7d2a-4b63-8c33-bbc921313a40 tempest-VolumesListTestJSON-1317415653 None] Created reservations ['a84cbae1-0304-4c71-914d-ff4261335794', '0cd2ecb9-3324-4781-a186-b3b93805c151', 'd68d64d4-aab5-48d6-b432-3362af771384', '8688bc26-0b48-4885-9b2f-c735bac5a2e9'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:30:54 devstack sudo[92627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613 Nov 06 14:30:54 devstack sudo[92627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ffad75cb-7d2a-4b63-8c33-bbc921313a40 tempest-VolumesListTestJSON-1317415653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ffad75cb-7d2a-4b63-8c33-bbc921313a40 tempest-VolumesListTestJSON-1317415653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ffad75cb-7d2a-4b63-8c33-bbc921313a40 tempest-VolumesListTestJSON-1317415653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:30:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ffad75cb-7d2a-4b63-8c33-bbc921313a40 tempest-VolumesListTestJSON-1317415653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:30:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ffad75cb-7d2a-4b63-8c33-bbc921313a40 tempest-VolumesListTestJSON-1317415653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ffad75cb-7d2a-4b63-8c33-bbc921313a40 tempest-VolumesListTestJSON-1317415653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:54 devstack sudo[92629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:30:54 devstack sudo[92629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:54 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7a858143-ce3a-45e3-8f59-a2ce5fbcb7c2 tempest-VolumesListTestJSON-1317415653 None] Acquiring lock "cinder-ea01c08c-7354-4fba-9611-5344738af057-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:30:54 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7a858143-ce3a-45e3-8f59-a2ce5fbcb7c2 tempest-VolumesListTestJSON-1317415653 None] Lock "cinder-ea01c08c-7354-4fba-9611-5344738af057-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:30:54 devstack sudo[92627]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613" returned: 0 in 0.339s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:30:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc0f24c-6cba-4735-9988-cd09d6c912b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad954caa-6704-4673-abad-4b771913e613', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afff747b-f9a4-4398-b414-05c3b9750238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:30:54 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Volume volume-ad954caa-6704-4673-abad-4b771913e613 (ad954caa-6704-4673-abad-4b771913e613): created successfully Nov 06 14:30:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afff747b-f9a4-4398-b414-05c3b9750238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:30:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Flow 'volume_create_manager' (0f432ce9-aaf0-4c7c-91ee-ba30fb6b081b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:30:54 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7a858143-ce3a-45e3-8f59-a2ce5fbcb7c2 tempest-VolumesListTestJSON-1317415653 None] Acquiring lock "cinder-quobyte-ea01c08c-7354-4fba-9611-5344738af057" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:30:54 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-1d206cef-9da4-4c39-82cc-f3dd5fd897c2 tempest-VolumesExtendTest-1683989370 None] Created volume successfully. Nov 06 14:30:54 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7a858143-ce3a-45e3-8f59-a2ce5fbcb7c2 tempest-VolumesListTestJSON-1317415653 None] Lock "cinder-quobyte-ea01c08c-7354-4fba-9611-5344738af057" acquired by "delete_volume" :: waited 0.018s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:30:54 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7befef-7907-4116-9133-513017b7f2d0]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:30:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7a858143-ce3a-45e3-8f59-a2ce5fbcb7c2 tempest-VolumesListTestJSON-1317415653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ea01c08c-7354-4fba-9611-5344738af057 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:54 devstack sudo[92629]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ffad75cb-7d2a-4b63-8c33-bbc921313a40 tempest-VolumesListTestJSON-1317415653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.362s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:54 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-ffad75cb-7d2a-4b63-8c33-bbc921313a40 tempest-VolumesListTestJSON-1317415653 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:30:54 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-ffad75cb-7d2a-4b63-8c33-bbc921313a40 tempest-VolumesListTestJSON-1317415653 None] Deleted volume successfully. Nov 06 14:30:54 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ffad75cb-7d2a-4b63-8c33-bbc921313a40 tempest-VolumesListTestJSON-1317415653 None] Lock "cinder-31507b58-50ab-46f7-ab00-091fec434837-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:30:54 devstack sudo[92633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ea01c08c-7354-4fba-9611-5344738af057 Nov 06 14:30:54 devstack sudo[92633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:54 devstack sudo[92633]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7a858143-ce3a-45e3-8f59-a2ce5fbcb7c2 tempest-VolumesListTestJSON-1317415653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ea01c08c-7354-4fba-9611-5344738af057" returned: 0 in 0.521s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7a858143-ce3a-45e3-8f59-a2ce5fbcb7c2 tempest-VolumesListTestJSON-1317415653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ea01c08c-7354-4fba-9611-5344738af057 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:55 devstack sudo[92642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ea01c08c-7354-4fba-9611-5344738af057 Nov 06 14:30:55 devstack sudo[92642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:55 devstack sudo[92642]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7a858143-ce3a-45e3-8f59-a2ce5fbcb7c2 tempest-VolumesListTestJSON-1317415653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ea01c08c-7354-4fba-9611-5344738af057" returned: 0 in 0.300s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:55 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7a858143-ce3a-45e3-8f59-a2ce5fbcb7c2 tempest-VolumesListTestJSON-1317415653 None] Lock "cinder-quobyte-ea01c08c-7354-4fba-9611-5344738af057" released by "delete_volume" :: held 0.881s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:30:55 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-7a858143-ce3a-45e3-8f59-a2ce5fbcb7c2 tempest-VolumesListTestJSON-1317415653 None] Created reservations ['6436a511-2e39-4d3b-8426-43bdfd44976d', 'b2afa932-27fd-4c35-850b-ecd963083cfc', '8ce9cb42-3b57-4459-a20f-b020ec7df8e4', '89ea0e5e-a535-453b-bff0-1afdd3daf21a'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:30:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7a858143-ce3a-45e3-8f59-a2ce5fbcb7c2 tempest-VolumesListTestJSON-1317415653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7a858143-ce3a-45e3-8f59-a2ce5fbcb7c2 tempest-VolumesListTestJSON-1317415653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7a858143-ce3a-45e3-8f59-a2ce5fbcb7c2 tempest-VolumesListTestJSON-1317415653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:30:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7a858143-ce3a-45e3-8f59-a2ce5fbcb7c2 tempest-VolumesListTestJSON-1317415653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:30:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7a858143-ce3a-45e3-8f59-a2ce5fbcb7c2 tempest-VolumesListTestJSON-1317415653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7a858143-ce3a-45e3-8f59-a2ce5fbcb7c2 tempest-VolumesListTestJSON-1317415653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:55 devstack sudo[92645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:30:55 devstack sudo[92645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-18f64d86-f773-4fb2-8694-8000ad40bfa0 tempest-VolumesExtendTest-1683989370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-18f64d86-f773-4fb2-8694-8000ad40bfa0 tempest-VolumesExtendTest-1683989370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-18f64d86-f773-4fb2-8694-8000ad40bfa0 tempest-VolumesExtendTest-1683989370 None] Creating offline snapshot f0d20320-137d-40a4-b039-4402c76a51b8 of volume ad954caa-6704-4673-abad-4b771913e613 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:30:55 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbf4e83-a71d-43c1-9a14-a39ebac44a36]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:30:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-18f64d86-f773-4fb2-8694-8000ad40bfa0 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:55 devstack sudo[92648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613 Nov 06 14:30:55 devstack sudo[92648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:55 devstack sudo[92645]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7a858143-ce3a-45e3-8f59-a2ce5fbcb7c2 tempest-VolumesListTestJSON-1317415653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.376s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:55 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-7a858143-ce3a-45e3-8f59-a2ce5fbcb7c2 tempest-VolumesListTestJSON-1317415653 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:30:55 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-7a858143-ce3a-45e3-8f59-a2ce5fbcb7c2 tempest-VolumesListTestJSON-1317415653 None] Deleted volume successfully. Nov 06 14:30:55 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7a858143-ce3a-45e3-8f59-a2ce5fbcb7c2 tempest-VolumesListTestJSON-1317415653 None] Lock "cinder-ea01c08c-7354-4fba-9611-5344738af057-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:30:56 devstack sudo[92648]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-18f64d86-f773-4fb2-8694-8000ad40bfa0 tempest-VolumesExtendTest-1683989370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613" returned: 0 in 0.514s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-18f64d86-f773-4fb2-8694-8000ad40bfa0 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613.f0d20320-137d-40a4-b039-4402c76a51b8 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:56 devstack sudo[92655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613.f0d20320-137d-40a4-b039-4402c76a51b8 1G Nov 06 14:30:56 devstack sudo[92655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:56 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-568713c3-2427-45eb-83c7-1af57691a9e1 tempest-VolumesListTestJSON-1317415653 None] Acquiring lock "cinder-28e37961-8d59-4123-b110-186867cf2c3b-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:30:56 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-568713c3-2427-45eb-83c7-1af57691a9e1 tempest-VolumesListTestJSON-1317415653 None] Lock "cinder-28e37961-8d59-4123-b110-186867cf2c3b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:30:56 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-568713c3-2427-45eb-83c7-1af57691a9e1 tempest-VolumesListTestJSON-1317415653 None] Acquiring lock "cinder-quobyte-28e37961-8d59-4123-b110-186867cf2c3b" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:30:56 devstack sudo[92655]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:56 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-568713c3-2427-45eb-83c7-1af57691a9e1 tempest-VolumesListTestJSON-1317415653 None] Lock "cinder-quobyte-28e37961-8d59-4123-b110-186867cf2c3b" acquired by "delete_volume" :: waited 0.038s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:30:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-18f64d86-f773-4fb2-8694-8000ad40bfa0 tempest-VolumesExtendTest-1683989370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613.f0d20320-137d-40a4-b039-4402c76a51b8 1G" returned: 0 in 0.699s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-18f64d86-f773-4fb2-8694-8000ad40bfa0 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad954caa-6704-4673-abad-4b771913e613 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613.f0d20320-137d-40a4-b039-4402c76a51b8 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:56 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[0314ed55-9641-4cf1-8543-1a40698833af]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:30:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-568713c3-2427-45eb-83c7-1af57691a9e1 tempest-VolumesListTestJSON-1317415653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-28e37961-8d59-4123-b110-186867cf2c3b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:56 devstack sudo[92670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad954caa-6704-4673-abad-4b771913e613 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613.f0d20320-137d-40a4-b039-4402c76a51b8 Nov 06 14:30:56 devstack sudo[92670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-3d816273-d38f-4893-9117-76733fe60358 req-15d1b228-53ea-4519-b37f-ca97acf024cb tempest-ServerActionsTestOtherA-1610590813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:57 devstack sudo[92671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-28e37961-8d59-4123-b110-186867cf2c3b Nov 06 14:30:57 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:57 devstack sudo[92670]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-18f64d86-f773-4fb2-8694-8000ad40bfa0 tempest-VolumesExtendTest-1683989370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad954caa-6704-4673-abad-4b771913e613 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613.f0d20320-137d-40a4-b039-4402c76a51b8" returned: 0 in 0.407s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:57 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-18f64d86-f773-4fb2-8694-8000ad40bfa0 tempest-VolumesExtendTest-1683989370 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613.f0d20320-137d-40a4-b039-4402c76a51b8 is being set with open permissions: ugo+rw Nov 06 14:30:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-18f64d86-f773-4fb2-8694-8000ad40bfa0 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613.f0d20320-137d-40a4-b039-4402c76a51b8 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:57 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613.f0d20320-137d-40a4-b039-4402c76a51b8 Nov 06 14:30:57 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:57 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-568713c3-2427-45eb-83c7-1af57691a9e1 tempest-VolumesListTestJSON-1317415653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-28e37961-8d59-4123-b110-186867cf2c3b" returned: 0 in 0.509s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-568713c3-2427-45eb-83c7-1af57691a9e1 tempest-VolumesListTestJSON-1317415653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-28e37961-8d59-4123-b110-186867cf2c3b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:57 devstack sudo[92685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-28e37961-8d59-4123-b110-186867cf2c3b Nov 06 14:30:57 devstack sudo[92685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:57 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-18f64d86-f773-4fb2-8694-8000ad40bfa0 tempest-VolumesExtendTest-1683989370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613.f0d20320-137d-40a4-b039-4402c76a51b8" returned: 0 in 0.315s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-18f64d86-f773-4fb2-8694-8000ad40bfa0 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:57 devstack sudo[92690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613.info Nov 06 14:30:57 devstack sudo[92690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:57 devstack sudo[92685]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-568713c3-2427-45eb-83c7-1af57691a9e1 tempest-VolumesListTestJSON-1317415653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-28e37961-8d59-4123-b110-186867cf2c3b" returned: 0 in 0.382s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:57 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-568713c3-2427-45eb-83c7-1af57691a9e1 tempest-VolumesListTestJSON-1317415653 None] Lock "cinder-quobyte-28e37961-8d59-4123-b110-186867cf2c3b" released by "delete_volume" :: held 0.974s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:30:57 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-568713c3-2427-45eb-83c7-1af57691a9e1 tempest-VolumesListTestJSON-1317415653 None] Created reservations ['6f28123e-8cf6-4481-9f7d-03faeab72744', 'a6f9c841-08c3-468c-a8fb-87b3c448dc66', '157d49cc-bb14-4a0c-8ec3-24ff463723eb', 'e6c775c5-6bca-4f9b-947d-96596a8d898c'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:30:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-568713c3-2427-45eb-83c7-1af57691a9e1 tempest-VolumesListTestJSON-1317415653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-568713c3-2427-45eb-83c7-1af57691a9e1 tempest-VolumesListTestJSON-1317415653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-568713c3-2427-45eb-83c7-1af57691a9e1 tempest-VolumesListTestJSON-1317415653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:30:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-568713c3-2427-45eb-83c7-1af57691a9e1 tempest-VolumesListTestJSON-1317415653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:30:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-568713c3-2427-45eb-83c7-1af57691a9e1 tempest-VolumesListTestJSON-1317415653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-568713c3-2427-45eb-83c7-1af57691a9e1 tempest-VolumesListTestJSON-1317415653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:58 devstack sudo[92690]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-18f64d86-f773-4fb2-8694-8000ad40bfa0 tempest-VolumesExtendTest-1683989370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613.info" returned: 0 in 0.381s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:58 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-18f64d86-f773-4fb2-8694-8000ad40bfa0 tempest-VolumesExtendTest-1683989370 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613.info is being set with open permissions: ugo+rw Nov 06 14:30:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-18f64d86-f773-4fb2-8694-8000ad40bfa0 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:58 devstack sudo[92694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:30:58 devstack sudo[92694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:58 devstack sudo[92696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613.info Nov 06 14:30:58 devstack sudo[92696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:58 devstack sudo[92694]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-568713c3-2427-45eb-83c7-1af57691a9e1 tempest-VolumesListTestJSON-1317415653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.296s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:58 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-568713c3-2427-45eb-83c7-1af57691a9e1 tempest-VolumesListTestJSON-1317415653 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:30:58 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-568713c3-2427-45eb-83c7-1af57691a9e1 tempest-VolumesListTestJSON-1317415653 None] Deleted volume successfully. Nov 06 14:30:58 devstack sudo[92696]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-18f64d86-f773-4fb2-8694-8000ad40bfa0 tempest-VolumesExtendTest-1683989370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613.info" returned: 0 in 0.297s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-18f64d86-f773-4fb2-8694-8000ad40bfa0 tempest-VolumesExtendTest-1683989370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.777s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-3d816273-d38f-4893-9117-76733fe60358 req-15d1b228-53ea-4519-b37f-ca97acf024cb tempest-ServerActionsTestOtherA-1610590813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.351s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:58 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-568713c3-2427-45eb-83c7-1af57691a9e1 tempest-VolumesListTestJSON-1317415653 None] Lock "cinder-28e37961-8d59-4123-b110-186867cf2c3b-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:30:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-3d816273-d38f-4893-9117-76733fe60358 req-15d1b228-53ea-4519-b37f-ca97acf024cb tempest-ServerActionsTestOtherA-1610590813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:58 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-18f64d86-f773-4fb2-8694-8000ad40bfa0 tempest-VolumesExtendTest-1683989370 None] Create snapshot completed successfully Nov 06 14:30:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-3d816273-d38f-4893-9117-76733fe60358 req-15d1b228-53ea-4519-b37f-ca97acf024cb tempest-ServerActionsTestOtherA-1610590813 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e', 'name': 'volume-e7d497f6-f98c-443f-8535-9398feb12a27', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f8269a4-9068-4a26-8abf-74745cbfddce', 'enforce_multipath': True} {{(pid=86854) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 14:30:58 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-3d816273-d38f-4893-9117-76733fe60358 req-15d1b228-53ea-4519-b37f-ca97acf024cb tempest-ServerActionsTestOtherA-1610590813 None] attachment_update completed successfully. Nov 06 14:30:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8fea5cff-2844-45e4-a8e4-46b42c61d7dc tempest-VolumesExtendTest-1683989370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:30:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8fea5cff-2844-45e4-a8e4-46b42c61d7dc tempest-VolumesExtendTest-1683989370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:30:59 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4eef90-783c-46cb-bc88-19824dfe0223]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:30:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8fea5cff-2844-45e4-a8e4-46b42c61d7dc tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:59 devstack sudo[92701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613 Nov 06 14:30:59 devstack sudo[92701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:30:59 devstack sudo[92701]: pam_unix(sudo:session): session closed for user root Nov 06 14:30:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8fea5cff-2844-45e4-a8e4-46b42c61d7dc tempest-VolumesExtendTest-1683989370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613" returned: 0 in 0.525s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8fea5cff-2844-45e4-a8e4-46b42c61d7dc tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613.f0d20320-137d-40a4-b039-4402c76a51b8 2G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:30:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8fea5cff-2844-45e4-a8e4-46b42c61d7dc tempest-VolumesExtendTest-1683989370 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613.f0d20320-137d-40a4-b039-4402c76a51b8 2G" returned: 0 in 0.189s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:30:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8fea5cff-2844-45e4-a8e4-46b42c61d7dc tempest-VolumesExtendTest-1683989370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.797s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:30:59 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-8fea5cff-2844-45e4-a8e4-46b42c61d7dc tempest-VolumesExtendTest-1683989370 None] Extend volume completed successfully. Nov 06 14:31:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-29c4c351-c451-4175-9c16-d773f85662d7 tempest-VolumesExtendTest-1683989370 None] Acquiring lock "cinder-f0d20320-137d-40a4-b039-4402c76a51b8-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:31:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-29c4c351-c451-4175-9c16-d773f85662d7 tempest-VolumesExtendTest-1683989370 None] Lock "cinder-f0d20320-137d-40a4-b039-4402c76a51b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:31:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-29c4c351-c451-4175-9c16-d773f85662d7 tempest-VolumesExtendTest-1683989370 None] Acquiring lock "cinder-quobyte-ad954caa-6704-4673-abad-4b771913e613" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:31:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-29c4c351-c451-4175-9c16-d773f85662d7 tempest-VolumesExtendTest-1683989370 None] Lock "cinder-quobyte-ad954caa-6704-4673-abad-4b771913e613" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:31:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-29c4c351-c451-4175-9c16-d773f85662d7 tempest-VolumesExtendTest-1683989370 None] Acquiring lock "cinder-quobyte-f0d20320-137d-40a4-b039-4402c76a51b8" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:31:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-29c4c351-c451-4175-9c16-d773f85662d7 tempest-VolumesExtendTest-1683989370 None] Lock "cinder-quobyte-f0d20320-137d-40a4-b039-4402c76a51b8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:31:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-29c4c351-c451-4175-9c16-d773f85662d7 tempest-VolumesExtendTest-1683989370 None] Deleting offline snapshot f0d20320-137d-40a4-b039-4402c76a51b8 of volume ad954caa-6704-4673-abad-4b771913e613 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:31:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-29c4c351-c451-4175-9c16-d773f85662d7 tempest-VolumesExtendTest-1683989370 None] snapshot_file for this snap is: volume-ad954caa-6704-4673-abad-4b771913e613.f0d20320-137d-40a4-b039-4402c76a51b8 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:31:00 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7660f9d-c094-44e0-8ba5-b6d292fbb681]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:31:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-29c4c351-c451-4175-9c16-d773f85662d7 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613.f0d20320-137d-40a4-b039-4402c76a51b8 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:00 devstack sudo[92711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613.f0d20320-137d-40a4-b039-4402c76a51b8 Nov 06 14:31:00 devstack sudo[92711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:00 devstack sudo[92711]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-29c4c351-c451-4175-9c16-d773f85662d7 tempest-VolumesExtendTest-1683989370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613.f0d20320-137d-40a4-b039-4402c76a51b8" returned: 0 in 0.457s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-29c4c351-c451-4175-9c16-d773f85662d7 tempest-VolumesExtendTest-1683989370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad954caa-6704-4673-abad-4b771913e613(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:31:01 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe46747-dd53-43f4-9916-26455fb8ff64]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:31:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-29c4c351-c451-4175-9c16-d773f85662d7 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:01 devstack sudo[92717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613 Nov 06 14:31:01 devstack sudo[92717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:01 devstack sudo[92717]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-29c4c351-c451-4175-9c16-d773f85662d7 tempest-VolumesExtendTest-1683989370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613" returned: 0 in 0.479s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-29c4c351-c451-4175-9c16-d773f85662d7 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613.f0d20320-137d-40a4-b039-4402c76a51b8 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:01 devstack sudo[92756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613.f0d20320-137d-40a4-b039-4402c76a51b8 Nov 06 14:31:01 devstack sudo[92756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:02 devstack sudo[92756]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-29c4c351-c451-4175-9c16-d773f85662d7 tempest-VolumesExtendTest-1683989370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613.f0d20320-137d-40a4-b039-4402c76a51b8" returned: 0 in 0.623s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-29c4c351-c451-4175-9c16-d773f85662d7 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613.f0d20320-137d-40a4-b039-4402c76a51b8 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:02 devstack sudo[92863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613.f0d20320-137d-40a4-b039-4402c76a51b8 Nov 06 14:31:02 devstack sudo[92863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:02 devstack sudo[92863]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-29c4c351-c451-4175-9c16-d773f85662d7 tempest-VolumesExtendTest-1683989370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613.f0d20320-137d-40a4-b039-4402c76a51b8" returned: 0 in 0.576s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:02 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-29c4c351-c451-4175-9c16-d773f85662d7 tempest-VolumesExtendTest-1683989370 None] Lock "cinder-quobyte-f0d20320-137d-40a4-b039-4402c76a51b8" released by "_delete_snapshot" :: held 2.371s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:31:02 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-29c4c351-c451-4175-9c16-d773f85662d7 tempest-VolumesExtendTest-1683989370 None] Lock "cinder-quobyte-ad954caa-6704-4673-abad-4b771913e613" released by "delete_snapshot" :: held 2.415s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:31:03 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-29c4c351-c451-4175-9c16-d773f85662d7 tempest-VolumesExtendTest-1683989370 None] Created reservations ['8f13f863-f241-47c6-a2ec-0f9a9180b76a', '1f563d61-d65b-44b9-8fd4-242107b6d1c0', 'b2efcaff-a933-45cd-b3e9-7324c5387b27', '7bd1c389-1c6c-4413-83be-6202c871831e'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:31:03 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-29c4c351-c451-4175-9c16-d773f85662d7 tempest-VolumesExtendTest-1683989370 None] Delete snapshot completed successfully. Nov 06 14:31:03 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-29c4c351-c451-4175-9c16-d773f85662d7 tempest-VolumesExtendTest-1683989370 None] Lock "cinder-f0d20320-137d-40a4-b039-4402c76a51b8-delete_snapshot" released by "delete_snapshot" :: held 2.737s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:31:03 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-58a92973-481b-43be-a83c-7b2f4c633495 tempest-VolumesExtendTest-1683989370 None] Acquiring lock "cinder-ad954caa-6704-4673-abad-4b771913e613-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:31:03 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-58a92973-481b-43be-a83c-7b2f4c633495 tempest-VolumesExtendTest-1683989370 None] Lock "cinder-ad954caa-6704-4673-abad-4b771913e613-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:31:03 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-58a92973-481b-43be-a83c-7b2f4c633495 tempest-VolumesExtendTest-1683989370 None] Acquiring lock "cinder-quobyte-ad954caa-6704-4673-abad-4b771913e613" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:31:03 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-58a92973-481b-43be-a83c-7b2f4c633495 tempest-VolumesExtendTest-1683989370 None] Lock "cinder-quobyte-ad954caa-6704-4673-abad-4b771913e613" acquired by "delete_volume" :: waited 0.026s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:31:03 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbb672e-7f95-422e-a806-df3fc1c06136]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:31:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-58a92973-481b-43be-a83c-7b2f4c633495 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:04 devstack sudo[93218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613 Nov 06 14:31:04 devstack sudo[93218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:04 devstack sudo[93218]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-58a92973-481b-43be-a83c-7b2f4c633495 tempest-VolumesExtendTest-1683989370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613" returned: 0 in 0.483s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-58a92973-481b-43be-a83c-7b2f4c633495 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:04 devstack sudo[93228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613 Nov 06 14:31:04 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:04 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-58a92973-481b-43be-a83c-7b2f4c633495 tempest-VolumesExtendTest-1683989370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ad954caa-6704-4673-abad-4b771913e613" returned: 0 in 0.529s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:05 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-58a92973-481b-43be-a83c-7b2f4c633495 tempest-VolumesExtendTest-1683989370 None] Lock "cinder-quobyte-ad954caa-6704-4673-abad-4b771913e613" released by "delete_volume" :: held 1.153s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:31:05 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-58a92973-481b-43be-a83c-7b2f4c633495 tempest-VolumesExtendTest-1683989370 None] Created reservations ['30f4b59b-20fe-462e-90ef-617dcd717128', '3c52c642-7639-402d-b635-4bc4f7af76f2', '3b53977e-8e91-4927-b83d-b17c6e202014', 'e6babed5-64a3-472b-b10b-9b470040c315'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:31:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-58a92973-481b-43be-a83c-7b2f4c633495 tempest-VolumesExtendTest-1683989370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:31:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-58a92973-481b-43be-a83c-7b2f4c633495 tempest-VolumesExtendTest-1683989370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:31:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-58a92973-481b-43be-a83c-7b2f4c633495 tempest-VolumesExtendTest-1683989370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:31:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-58a92973-481b-43be-a83c-7b2f4c633495 tempest-VolumesExtendTest-1683989370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:31:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-58a92973-481b-43be-a83c-7b2f4c633495 tempest-VolumesExtendTest-1683989370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:31:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-58a92973-481b-43be-a83c-7b2f4c633495 tempest-VolumesExtendTest-1683989370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:05 devstack sudo[93231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:31:05 devstack sudo[93231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:05 devstack sudo[93231]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-58a92973-481b-43be-a83c-7b2f4c633495 tempest-VolumesExtendTest-1683989370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.412s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:05 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-58a92973-481b-43be-a83c-7b2f4c633495 tempest-VolumesExtendTest-1683989370 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:31:05 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-58a92973-481b-43be-a83c-7b2f4c633495 tempest-VolumesExtendTest-1683989370 None] Deleted volume successfully. Nov 06 14:31:05 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-58a92973-481b-43be-a83c-7b2f4c633495 tempest-VolumesExtendTest-1683989370 None] Lock "cinder-ad954caa-6704-4673-abad-4b771913e613-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:31:16 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:31:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Flow 'volume_create_manager' (f9a54f47-c95b-4463-a2e1-07f42c0680e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:31:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5587b45-79ef-4b5c-991b-d0084e5b6c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5587b45-79ef-4b5c-991b-d0084e5b6c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1126302494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ba0b74-eb9e-410d-a98e-89341715dd84,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3ddb34a0bd44464c9f3c8c1e91372fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:31:16Z,use_quota=True,user_id='a16623f4615c49c79407ce9eb7add66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d5a1f3d-c5e1-484e-923e-6a7bc3e44d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d5a1f3d-c5e1-484e-923e-6a7bc3e44d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ee33c8-d521-4964-86fb-dc595cc4934d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ee33c8-d521-4964-86fb-dc595cc4934d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2ba0b74-eb9e-410d-a98e-89341715dd84', 'volume_name': 'volume-a2ba0b74-eb9e-410d-a98e-89341715dd84', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0396bc0-ad27-497a-88d5-bc991ad911a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0396bc0-ad27-497a-88d5-bc991ad911a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c3c20b-c9bc-4013-ad95-4552a822e95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:16 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Volume a2ba0b74-eb9e-410d-a98e-89341715dd84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2ba0b74-eb9e-410d-a98e-89341715dd84', 'volume_size': 1} Nov 06 14:31:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:31:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:31:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1126302494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ba0b74-eb9e-410d-a98e-89341715dd84,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3ddb34a0bd44464c9f3c8c1e91372fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:31:16Z,use_quota=True,user_id='a16623f4615c49c79407ce9eb7add66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:31:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Creating volume a2ba0b74-eb9e-410d-a98e-89341715dd84 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:31:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:31:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:31:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:31:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:31:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:31:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:31:16 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:31:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a2ba0b74-eb9e-410d-a98e-89341715dd84 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:16 devstack sudo[93254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a2ba0b74-eb9e-410d-a98e-89341715dd84 1073741824 Nov 06 14:31:16 devstack sudo[93254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:16 devstack sudo[93254]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a2ba0b74-eb9e-410d-a98e-89341715dd84 1073741824" returned: 0 in 0.694s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a2ba0b74-eb9e-410d-a98e-89341715dd84 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:16 devstack sudo[93260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a2ba0b74-eb9e-410d-a98e-89341715dd84 Nov 06 14:31:16 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:17 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a2ba0b74-eb9e-410d-a98e-89341715dd84" returned: 0 in 0.463s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:31:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:31:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c3c20b-c9bc-4013-ad95-4552a822e95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2ba0b74-eb9e-410d-a98e-89341715dd84', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d4d290-75cf-4c39-b555-cb40058a44fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:17 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Volume volume-a2ba0b74-eb9e-410d-a98e-89341715dd84 (a2ba0b74-eb9e-410d-a98e-89341715dd84): created successfully Nov 06 14:31:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d4d290-75cf-4c39-b555-cb40058a44fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Flow 'volume_create_manager' (f9a54f47-c95b-4463-a2e1-07f42c0680e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:31:17 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-070f2328-c4ef-4ed1-bcf6-7b923209bcab tempest-VolumesGetTest-1244886629 None] Created volume successfully. Nov 06 14:31:19 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:31:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Flow 'volume_create_manager' (24f62fdc-2c28-4fcd-9048-d8326cc4c3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:31:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b02c2b-0cc2-4f61-bef9-b65feaaff567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b02c2b-0cc2-4f61-bef9-b65feaaff567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:31:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-843249136',display_name='tempest-VolumesGetTest-Volume-1624300149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d57c18a8-0f1f-4676-8edf-39f63ee81f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ddb34a0bd44464c9f3c8c1e91372fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:31:19Z,use_quota=True,user_id='a16623f4615c49c79407ce9eb7add66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d024151-387d-48a1-868b-305329eae645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d024151-387d-48a1-868b-305329eae645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f011af70-55f0-4c3f-bd00-13e864a94620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f011af70-55f0-4c3f-bd00-13e864a94620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd57c18a8-0f1f-4676-8edf-39f63ee81f45', 'volume_name': 'volume-d57c18a8-0f1f-4676-8edf-39f63ee81f45', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7123ca7e-06f8-4e60-8c44-c00c2d1fa2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7123ca7e-06f8-4e60-8c44-c00c2d1fa2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad4ab7c-2c89-474a-9bc1-860018153cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:19 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Volume d57c18a8-0f1f-4676-8edf-39f63ee81f45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d57c18a8-0f1f-4676-8edf-39f63ee81f45', 'volume_size': 1} Nov 06 14:31:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:31:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:31:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:31:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-843249136',display_name='tempest-VolumesGetTest-Volume-1624300149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d57c18a8-0f1f-4676-8edf-39f63ee81f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ddb34a0bd44464c9f3c8c1e91372fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:31:19Z,use_quota=True,user_id='a16623f4615c49c79407ce9eb7add66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:31:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Creating volume d57c18a8-0f1f-4676-8edf-39f63ee81f45 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:31:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:31:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:31:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:31:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:31:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:31:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:31:19 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:31:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d57c18a8-0f1f-4676-8edf-39f63ee81f45 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:19 devstack sudo[93267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d57c18a8-0f1f-4676-8edf-39f63ee81f45 1073741824 Nov 06 14:31:19 devstack sudo[93267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:20 devstack sudo[93267]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d57c18a8-0f1f-4676-8edf-39f63ee81f45 1073741824" returned: 0 in 0.827s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d57c18a8-0f1f-4676-8edf-39f63ee81f45 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:20 devstack sudo[93279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d57c18a8-0f1f-4676-8edf-39f63ee81f45 Nov 06 14:31:20 devstack sudo[93279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:21 devstack sudo[93279]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d57c18a8-0f1f-4676-8edf-39f63ee81f45" returned: 0 in 0.526s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:31:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:31:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad4ab7c-2c89-474a-9bc1-860018153cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d57c18a8-0f1f-4676-8edf-39f63ee81f45', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8218fd-b7c8-4364-96ae-19e23e46c57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:21 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Volume volume-d57c18a8-0f1f-4676-8edf-39f63ee81f45 (d57c18a8-0f1f-4676-8edf-39f63ee81f45): created successfully Nov 06 14:31:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8218fd-b7c8-4364-96ae-19e23e46c57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Flow 'volume_create_manager' (24f62fdc-2c28-4fcd-9048-d8326cc4c3ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:31:21 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-6a0eeab7-bf9a-4fae-98f6-915bce3750d5 tempest-VolumesGetTest-1244886629 None] Created volume successfully. Nov 06 14:31:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2bdb119a-664c-4d3a-907b-6ec7682b6548 tempest-VolumesGetTest-1244886629 None] Acquiring lock "cinder-d57c18a8-0f1f-4676-8edf-39f63ee81f45-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:31:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2bdb119a-664c-4d3a-907b-6ec7682b6548 tempest-VolumesGetTest-1244886629 None] Lock "cinder-d57c18a8-0f1f-4676-8edf-39f63ee81f45-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:31:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2bdb119a-664c-4d3a-907b-6ec7682b6548 tempest-VolumesGetTest-1244886629 None] Acquiring lock "cinder-quobyte-d57c18a8-0f1f-4676-8edf-39f63ee81f45" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:31:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2bdb119a-664c-4d3a-907b-6ec7682b6548 tempest-VolumesGetTest-1244886629 None] Lock "cinder-quobyte-d57c18a8-0f1f-4676-8edf-39f63ee81f45" acquired by "delete_volume" :: waited 0.046s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:31:22 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[b793086d-35aa-4c2a-8d6b-1cc0d71168a4]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:31:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdb119a-664c-4d3a-907b-6ec7682b6548 tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d57c18a8-0f1f-4676-8edf-39f63ee81f45 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:22 devstack sudo[93314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d57c18a8-0f1f-4676-8edf-39f63ee81f45 Nov 06 14:31:22 devstack sudo[93314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:22 devstack sudo[93314]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdb119a-664c-4d3a-907b-6ec7682b6548 tempest-VolumesGetTest-1244886629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d57c18a8-0f1f-4676-8edf-39f63ee81f45" returned: 0 in 0.676s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdb119a-664c-4d3a-907b-6ec7682b6548 tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d57c18a8-0f1f-4676-8edf-39f63ee81f45 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:22 devstack sudo[93322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d57c18a8-0f1f-4676-8edf-39f63ee81f45 Nov 06 14:31:22 devstack sudo[93322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:31:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:31:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:31:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:31:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:31:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:31:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:23 devstack sudo[93325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:31:23 devstack sudo[93325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdb119a-664c-4d3a-907b-6ec7682b6548 tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d57c18a8-0f1f-4676-8edf-39f63ee81f45" returned: 0 in 0.628s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:23 devstack sudo[93322]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2bdb119a-664c-4d3a-907b-6ec7682b6548 tempest-VolumesGetTest-1244886629 None] Lock "cinder-quobyte-d57c18a8-0f1f-4676-8edf-39f63ee81f45" released by "delete_volume" :: held 1.424s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:31:23 devstack sudo[93325]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.411s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:23 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:31:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager._thread_info {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:31:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread count: 28 {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 14:31:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread info: [<_MainThread(MainThread, started 130306900594816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 14:31:23 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-2bdb119a-664c-4d3a-907b-6ec7682b6548 tempest-VolumesGetTest-1244886629 None] Created reservations ['2119ce3e-f85b-4622-98ed-9a43e160d4ea', '5d3ac438-a856-42d3-81e2-ba85b6a46def', 'a8a462ec-84d9-478a-9543-0c189d2c5ea8', '0a1f601d-4296-4ac0-bb3e-7401f925e1b8'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:31:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2bdb119a-664c-4d3a-907b-6ec7682b6548 tempest-VolumesGetTest-1244886629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:31:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2bdb119a-664c-4d3a-907b-6ec7682b6548 tempest-VolumesGetTest-1244886629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:31:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2bdb119a-664c-4d3a-907b-6ec7682b6548 tempest-VolumesGetTest-1244886629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:31:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2bdb119a-664c-4d3a-907b-6ec7682b6548 tempest-VolumesGetTest-1244886629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:31:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2bdb119a-664c-4d3a-907b-6ec7682b6548 tempest-VolumesGetTest-1244886629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:31:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdb119a-664c-4d3a-907b-6ec7682b6548 tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:23 devstack sudo[93348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:31:23 devstack sudo[93348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:24 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-13450e19-c29e-4bf9-86d8-702c599f810c req-e2f8de59-5a9b-40b0-aa2c-035b09c50388 tempest-ServerActionsTestOtherA-1610590813 None] Terminate volume connection completed successfully. Nov 06 14:31:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-13450e19-c29e-4bf9-86d8-702c599f810c req-e2f8de59-5a9b-40b0-aa2c-035b09c50388 tempest-ServerActionsTestOtherA-1610590813 None] Deleting attachment 5f8269a4-9068-4a26-8abf-74745cbfddce. {{(pid=86854) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 14:31:24 devstack sudo[93348]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdb119a-664c-4d3a-907b-6ec7682b6548 tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.514s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:24 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-2bdb119a-664c-4d3a-907b-6ec7682b6548 tempest-VolumesGetTest-1244886629 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:31:24 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-2bdb119a-664c-4d3a-907b-6ec7682b6548 tempest-VolumesGetTest-1244886629 None] Deleted volume successfully. Nov 06 14:31:24 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2bdb119a-664c-4d3a-907b-6ec7682b6548 tempest-VolumesGetTest-1244886629 None] Lock "cinder-d57c18a8-0f1f-4676-8edf-39f63ee81f45-delete_volume" released by "delete_volume" :: held 2.430s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:31:24 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-72b18a7b-46c9-47fd-b434-fae1d63722fc tempest-VolumesGetTest-1244886629 None] Acquiring lock "cinder-a2ba0b74-eb9e-410d-a98e-89341715dd84-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:31:24 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-72b18a7b-46c9-47fd-b434-fae1d63722fc tempest-VolumesGetTest-1244886629 None] Lock "cinder-a2ba0b74-eb9e-410d-a98e-89341715dd84-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:31:24 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-72b18a7b-46c9-47fd-b434-fae1d63722fc tempest-VolumesGetTest-1244886629 None] Acquiring lock "cinder-quobyte-a2ba0b74-eb9e-410d-a98e-89341715dd84" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:31:24 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-72b18a7b-46c9-47fd-b434-fae1d63722fc tempest-VolumesGetTest-1244886629 None] Lock "cinder-quobyte-a2ba0b74-eb9e-410d-a98e-89341715dd84" acquired by "delete_volume" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:31:24 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96243ae-92e5-424f-b5ec-a7a379f0ed4c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:31:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-72b18a7b-46c9-47fd-b434-fae1d63722fc tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a2ba0b74-eb9e-410d-a98e-89341715dd84 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:24 devstack sudo[93354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a2ba0b74-eb9e-410d-a98e-89341715dd84 Nov 06 14:31:24 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:25 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-72b18a7b-46c9-47fd-b434-fae1d63722fc tempest-VolumesGetTest-1244886629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a2ba0b74-eb9e-410d-a98e-89341715dd84" returned: 0 in 0.499s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-72b18a7b-46c9-47fd-b434-fae1d63722fc tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a2ba0b74-eb9e-410d-a98e-89341715dd84 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:25 devstack sudo[93363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a2ba0b74-eb9e-410d-a98e-89341715dd84 Nov 06 14:31:25 devstack sudo[93363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:25 devstack sudo[93363]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-72b18a7b-46c9-47fd-b434-fae1d63722fc tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a2ba0b74-eb9e-410d-a98e-89341715dd84" returned: 0 in 0.441s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:25 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-72b18a7b-46c9-47fd-b434-fae1d63722fc tempest-VolumesGetTest-1244886629 None] Lock "cinder-quobyte-a2ba0b74-eb9e-410d-a98e-89341715dd84" released by "delete_volume" :: held 1.014s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:31:25 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-72b18a7b-46c9-47fd-b434-fae1d63722fc tempest-VolumesGetTest-1244886629 None] Created reservations ['5a4497e5-3275-4a74-8981-26d83fbbc07b', 'e5ee65cc-f4e0-49ba-a465-8b389ddc5de6', 'b5bbefe3-b5b6-4972-a58d-c4e59054532d', '9191c3a7-9e49-46cb-9746-093bf73ecb6f'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:31:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-72b18a7b-46c9-47fd-b434-fae1d63722fc tempest-VolumesGetTest-1244886629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:31:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-72b18a7b-46c9-47fd-b434-fae1d63722fc tempest-VolumesGetTest-1244886629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:31:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-72b18a7b-46c9-47fd-b434-fae1d63722fc tempest-VolumesGetTest-1244886629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:31:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-72b18a7b-46c9-47fd-b434-fae1d63722fc tempest-VolumesGetTest-1244886629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:31:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-72b18a7b-46c9-47fd-b434-fae1d63722fc tempest-VolumesGetTest-1244886629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:31:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-72b18a7b-46c9-47fd-b434-fae1d63722fc tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:25 devstack sudo[93378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:31:25 devstack sudo[93378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:26 devstack sudo[93378]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-72b18a7b-46c9-47fd-b434-fae1d63722fc tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.327s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:26 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-72b18a7b-46c9-47fd-b434-fae1d63722fc tempest-VolumesGetTest-1244886629 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:31:26 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-72b18a7b-46c9-47fd-b434-fae1d63722fc tempest-VolumesGetTest-1244886629 None] Deleted volume successfully. Nov 06 14:31:26 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-72b18a7b-46c9-47fd-b434-fae1d63722fc tempest-VolumesGetTest-1244886629 None] Lock "cinder-a2ba0b74-eb9e-410d-a98e-89341715dd84-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:31:27 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:31:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Flow 'volume_create_manager' (45da3201-2e8a-4c81-8422-bfdc61819e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:31:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb8dcef8-789b-41f8-b592-68a39566523e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb8dcef8-789b-41f8-b592-68a39566523e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1490550027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2de826fa-6c11-4248-8f4a-37a5302076a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ddb34a0bd44464c9f3c8c1e91372fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:31:27Z,use_quota=True,user_id='a16623f4615c49c79407ce9eb7add66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55f6f52e-c09f-46eb-bcf4-0316d3c721b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55f6f52e-c09f-46eb-bcf4-0316d3c721b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c09a72-cbba-4031-8282-b85c15999e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c09a72-cbba-4031-8282-b85c15999e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2de826fa-6c11-4248-8f4a-37a5302076a3', 'volume_name': 'volume-2de826fa-6c11-4248-8f4a-37a5302076a3', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd05453-cd9c-48e0-bd01-fecd89ad25e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd05453-cd9c-48e0-bd01-fecd89ad25e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce77756a-37a7-43d2-87d4-f5bea6109d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:27 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Volume 2de826fa-6c11-4248-8f4a-37a5302076a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2de826fa-6c11-4248-8f4a-37a5302076a3', 'volume_size': 1} Nov 06 14:31:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:31:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:31:27 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1490550027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2de826fa-6c11-4248-8f4a-37a5302076a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ddb34a0bd44464c9f3c8c1e91372fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:31:27Z,use_quota=True,user_id='a16623f4615c49c79407ce9eb7add66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:31:27 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Creating volume 2de826fa-6c11-4248-8f4a-37a5302076a3 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:31:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:31:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:31:27 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:31:27 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:31:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:31:27 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:31:27 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:31:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:27 devstack sudo[93382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3 1073741824 Nov 06 14:31:27 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:27 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3 1073741824" returned: 0 in 0.537s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:28 devstack sudo[93396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3 Nov 06 14:31:28 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-13450e19-c29e-4bf9-86d8-702c599f810c req-632580af-4684-4cd1-a220-8c2fc563f86a tempest-ServerActionsTestOtherA-1610590813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:31:28 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3" returned: 0 in 0.392s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:31:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:31:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-13450e19-c29e-4bf9-86d8-702c599f810c req-632580af-4684-4cd1-a220-8c2fc563f86a tempest-ServerActionsTestOtherA-1610590813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.165s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:31:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce77756a-37a7-43d2-87d4-f5bea6109d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2de826fa-6c11-4248-8f4a-37a5302076a3', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c9bb60-a146-4229-847a-3bbf4023019b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-13450e19-c29e-4bf9-86d8-702c599f810c req-632580af-4684-4cd1-a220-8c2fc563f86a tempest-ServerActionsTestOtherA-1610590813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:31:28 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Volume volume-2de826fa-6c11-4248-8f4a-37a5302076a3 (2de826fa-6c11-4248-8f4a-37a5302076a3): created successfully Nov 06 14:31:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c9bb60-a146-4229-847a-3bbf4023019b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Flow 'volume_create_manager' (45da3201-2e8a-4c81-8422-bfdc61819e35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:31:28 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-6cefbf72-98c1-49a9-a80c-ca10e2b26998 tempest-VolumesGetTest-1244886629 None] Created volume successfully. Nov 06 14:31:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-13450e19-c29e-4bf9-86d8-702c599f810c req-632580af-4684-4cd1-a220-8c2fc563f86a tempest-ServerActionsTestOtherA-1610590813 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e', 'name': 'volume-e7d497f6-f98c-443f-8535-9398feb12a27', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf23a755-44cc-4ae2-96a3-183e98ebf3f1', 'enforce_multipath': True} {{(pid=86854) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 14:31:28 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-13450e19-c29e-4bf9-86d8-702c599f810c req-632580af-4684-4cd1-a220-8c2fc563f86a tempest-ServerActionsTestOtherA-1610590813 None] attachment_update completed successfully. Nov 06 14:31:30 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:31:30 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Flow 'volume_create_manager' (eefa75a7-63d0-4718-aaf1-13a38f463bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:31:30 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb3ef7c8-96fd-4f59-bcbf-2c7201ce01e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:30 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb3ef7c8-96fd-4f59-bcbf-2c7201ce01e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2076856328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0528c731-5b66-47ad-a7de-23e956b7f54e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3ddb34a0bd44464c9f3c8c1e91372fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=2de826fa-6c11-4248-8f4a-37a5302076a3,status='creating',terminated_at=None,updated_at=2026-11-06T13:31:31Z,use_quota=True,user_id='a16623f4615c49c79407ce9eb7add66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:30 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6d8600-29d7-4f29-bc53-42aa477f6dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:30 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6d8600-29d7-4f29-bc53-42aa477f6dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:30 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b17459d-a674-4de1-96d3-3c33436fec4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:30 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b17459d-a674-4de1-96d3-3c33436fec4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0528c731-5b66-47ad-a7de-23e956b7f54e', 'volume_name': 'volume-0528c731-5b66-47ad-a7de-23e956b7f54e', 'volume_size': 1, 'source_volid': '2de826fa-6c11-4248-8f4a-37a5302076a3', 'source_volstatus': 'available'}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:30 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c984e858-2371-45e8-a108-623cf32b1cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:30 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c984e858-2371-45e8-a108-623cf32b1cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:30 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d74e80b-7641-4067-b322-d305a844a3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:30 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Volume 0528c731-5b66-47ad-a7de-23e956b7f54e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0528c731-5b66-47ad-a7de-23e956b7f54e', 'volume_size': 1, 'source_volid': '2de826fa-6c11-4248-8f4a-37a5302076a3', 'source_volstatus': 'available'} Nov 06 14:31:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:31:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:31:30 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Cloning volume 2de826fa-6c11-4248-8f4a-37a5302076a3 to volume 0528c731-5b66-47ad-a7de-23e956b7f54e Nov 06 14:31:31 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Creating offline snapshot 35966b9e-c139-473f-b59d-e8671db5ee5d of volume 2de826fa-6c11-4248-8f4a-37a5302076a3 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:31:31 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2d49f4-ed64-41e6-837a-5ebc177af237]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:31:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:31 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3 Nov 06 14:31:31 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:31 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3" returned: 0 in 0.617s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.35966b9e-c139-473f-b59d-e8671db5ee5d 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:31 devstack sudo[93922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.35966b9e-c139-473f-b59d-e8671db5ee5d 1G Nov 06 14:31:31 devstack sudo[93922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:32 devstack sudo[93922]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.35966b9e-c139-473f-b59d-e8671db5ee5d 1G" returned: 0 in 1.102s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2de826fa-6c11-4248-8f4a-37a5302076a3 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.35966b9e-c139-473f-b59d-e8671db5ee5d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:32 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2de826fa-6c11-4248-8f4a-37a5302076a3 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.35966b9e-c139-473f-b59d-e8671db5ee5d Nov 06 14:31:32 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:33 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2de826fa-6c11-4248-8f4a-37a5302076a3 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.35966b9e-c139-473f-b59d-e8671db5ee5d" returned: 0 in 0.552s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:33 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.35966b9e-c139-473f-b59d-e8671db5ee5d is being set with open permissions: ugo+rw Nov 06 14:31:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.35966b9e-c139-473f-b59d-e8671db5ee5d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:33 devstack sudo[93935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.35966b9e-c139-473f-b59d-e8671db5ee5d Nov 06 14:31:33 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:33 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.35966b9e-c139-473f-b59d-e8671db5ee5d" returned: 0 in 0.582s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:33 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=118,cinder:INSERT=28,cinder:UPDATE=119,cinder:DELETE=10 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:31:33 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=107,cinder:INSERT=53,cinder:UPDATE=132,cinder:DELETE=10 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:31:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:34 devstack sudo[93938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.info Nov 06 14:31:34 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:34 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.info" returned: 0 in 0.590s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:34 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.info is being set with open permissions: ugo+rw Nov 06 14:31:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:34 devstack sudo[93942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.info Nov 06 14:31:34 devstack sudo[93942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:35 devstack sudo[93942]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.info" returned: 0 in 0.437s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Acquiring lock "cinder-quobyte-0528c731-5b66-47ad-a7de-23e956b7f54e" by "_copy_volume_from_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:31:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Lock "cinder-quobyte-0528c731-5b66-47ad-a7de-23e956b7f54e" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:31:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] snapshot: 35966b9e-c139-473f-b59d-e8671db5ee5d, volume: 0528c731-5b66-47ad-a7de-23e956b7f54e, {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 14:31:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:31:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:31:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:31:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:31:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:31:35 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf549033-2a77-4fb1-abde-379e8b1844c2]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:31:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.35966b9e-c139-473f-b59d-e8671db5ee5d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:35 devstack sudo[93945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.35966b9e-c139-473f-b59d-e8671db5ee5d Nov 06 14:31:35 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:35 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.35966b9e-c139-473f-b59d-e8671db5ee5d" returned: 0 in 0.700s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2de826fa-6c11-4248-8f4a-37a5302076a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:31:35 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[4760e72c-1dd6-42dc-9e1f-b6ac286247d1]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:31:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:36 devstack sudo[93950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3 Nov 06 14:31:36 devstack sudo[93950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:36 devstack sudo[93950]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3" returned: 0 in 0.793s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3 {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 14:31:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Creating direct copy from snapshot {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 14:31:36 devstack cinder-volume[86854]: DEBUG cinder.utils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Path /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0528c731-5b66-47ad-a7de-23e956b7f54e not found in is_blk_device check {{(pid=86854) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 14:31:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0528c731-5b66-47ad-a7de-23e956b7f54e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:36 devstack sudo[93956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0528c731-5b66-47ad-a7de-23e956b7f54e Nov 06 14:31:36 devstack sudo[93956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:44 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=1,cinder:INSERT=1 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:31:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0528c731-5b66-47ad-a7de-23e956b7f54e" returned: 0 in 13.996s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:50 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Image conversion details: src /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3, size 1024.00 MB, duration 14.00 sec, destination /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0528c731-5b66-47ad-a7de-23e956b7f54e {{(pid=86854) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 14:31:50 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Converted 1024.00 MB image at 73.16 MB/s Nov 06 14:31:50 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0528c731-5b66-47ad-a7de-23e956b7f54e is being set with open permissions: ugo+rw Nov 06 14:31:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0528c731-5b66-47ad-a7de-23e956b7f54e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:50 devstack sudo[94017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0528c731-5b66-47ad-a7de-23e956b7f54e Nov 06 14:31:50 devstack sudo[94017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:51 devstack sudo[94017]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0528c731-5b66-47ad-a7de-23e956b7f54e" returned: 0 in 0.453s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:51 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Lock "cinder-quobyte-0528c731-5b66-47ad-a7de-23e956b7f54e" released by "_copy_volume_from_snapshot" :: held 16.147s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:31:51 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Acquiring lock "cinder-quobyte-35966b9e-c139-473f-b59d-e8671db5ee5d" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:31:51 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Lock "cinder-quobyte-35966b9e-c139-473f-b59d-e8671db5ee5d" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:31:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Deleting offline snapshot 35966b9e-c139-473f-b59d-e8671db5ee5d of volume 2de826fa-6c11-4248-8f4a-37a5302076a3 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:31:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] snapshot_file for this snap is: volume-2de826fa-6c11-4248-8f4a-37a5302076a3.35966b9e-c139-473f-b59d-e8671db5ee5d {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:31:51 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e9b5a7-ec0d-43e9-8827-e6c67338794e]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:31:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.35966b9e-c139-473f-b59d-e8671db5ee5d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:51 devstack sudo[94023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.35966b9e-c139-473f-b59d-e8671db5ee5d Nov 06 14:31:51 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:51 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.35966b9e-c139-473f-b59d-e8671db5ee5d" returned: 0 in 0.491s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2de826fa-6c11-4248-8f4a-37a5302076a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:31:51 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e0834a-84d2-4713-869a-628e591f1506]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:31:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:51 devstack sudo[94030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3 Nov 06 14:31:51 devstack sudo[94030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:52 devstack sudo[94030]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3" returned: 0 in 0.562s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.35966b9e-c139-473f-b59d-e8671db5ee5d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:52 devstack sudo[94035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.35966b9e-c139-473f-b59d-e8671db5ee5d Nov 06 14:31:52 devstack sudo[94035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:52 devstack sudo[94035]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.35966b9e-c139-473f-b59d-e8671db5ee5d" returned: 0 in 0.381s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.35966b9e-c139-473f-b59d-e8671db5ee5d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:52 devstack sudo[94040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.35966b9e-c139-473f-b59d-e8671db5ee5d Nov 06 14:31:52 devstack sudo[94040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:53 devstack sudo[94040]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3.35966b9e-c139-473f-b59d-e8671db5ee5d" returned: 0 in 0.243s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Lock "cinder-quobyte-35966b9e-c139-473f-b59d-e8671db5ee5d" released by "_delete_snapshot" :: held 1.793s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:31:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.152s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:31:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d74e80b-7641-4067-b322-d305a844a3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0528c731-5b66-47ad-a7de-23e956b7f54e', 'volume_size': 1, 'source_volid': '2de826fa-6c11-4248-8f4a-37a5302076a3', 'source_volstatus': 'available'}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa3f7da-50ba-4f4d-8618-30d473e3b632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:53 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Volume volume-0528c731-5b66-47ad-a7de-23e956b7f54e (0528c731-5b66-47ad-a7de-23e956b7f54e): created successfully Nov 06 14:31:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa3f7da-50ba-4f4d-8618-30d473e3b632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Flow 'volume_create_manager' (eefa75a7-63d0-4718-aaf1-13a38f463bf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:31:53 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-25dc9ecc-c411-49ab-b055-d33d7f7d50cb tempest-VolumesGetTest-1244886629 None] Created volume successfully. Nov 06 14:31:54 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:31:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Flow 'volume_create_manager' (4a255870-36a8-4187-8240-ce0396110ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:31:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98dcfeea-6ef6-45b5-b8b5-a43691cb7753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98dcfeea-6ef6-45b5-b8b5-a43691cb7753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:31:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-870232972',display_name='tempest-VolumesGetTest-Volume-1031140770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc3e894-7d83-4f83-ae55-35f22055b099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ddb34a0bd44464c9f3c8c1e91372fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:31:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:31:54Z,use_quota=True,user_id='a16623f4615c49c79407ce9eb7add66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ee5010-6e34-47f4-be35-8c959a3f4261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ee5010-6e34-47f4-be35-8c959a3f4261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae5003d-28b2-4020-8ae9-6f56124106f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae5003d-28b2-4020-8ae9-6f56124106f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dc3e894-7d83-4f83-ae55-35f22055b099', 'volume_name': 'volume-5dc3e894-7d83-4f83-ae55-35f22055b099', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4bed10-fa0f-4ad8-9a04-c77086a190b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4bed10-fa0f-4ad8-9a04-c77086a190b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (267fe990-3ad1-4b0b-9986-54e44ab3d64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:54 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Volume 5dc3e894-7d83-4f83-ae55-35f22055b099: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dc3e894-7d83-4f83-ae55-35f22055b099', 'volume_size': 1} Nov 06 14:31:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:31:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:31:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:31:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-870232972',display_name='tempest-VolumesGetTest-Volume-1031140770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc3e894-7d83-4f83-ae55-35f22055b099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ddb34a0bd44464c9f3c8c1e91372fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:31:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:31:54Z,use_quota=True,user_id='a16623f4615c49c79407ce9eb7add66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:31:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Creating volume 5dc3e894-7d83-4f83-ae55-35f22055b099 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:31:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:31:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:31:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:31:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:31:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:31:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:31:54 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:31:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5dc3e894-7d83-4f83-ae55-35f22055b099 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:54 devstack sudo[94043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5dc3e894-7d83-4f83-ae55-35f22055b099 1073741824 Nov 06 14:31:54 devstack sudo[94043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:54 devstack sudo[94043]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5dc3e894-7d83-4f83-ae55-35f22055b099 1073741824" returned: 0 in 0.533s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5dc3e894-7d83-4f83-ae55-35f22055b099 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:54 devstack sudo[94049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5dc3e894-7d83-4f83-ae55-35f22055b099 Nov 06 14:31:54 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:55 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5dc3e894-7d83-4f83-ae55-35f22055b099" returned: 0 in 0.266s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (267fe990-3ad1-4b0b-9986-54e44ab3d64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dc3e894-7d83-4f83-ae55-35f22055b099', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (531dc092-b56f-4dce-a488-48301d0013d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:55 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Volume volume-5dc3e894-7d83-4f83-ae55-35f22055b099 (5dc3e894-7d83-4f83-ae55-35f22055b099): created successfully Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (531dc092-b56f-4dce-a488-48301d0013d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Flow 'volume_create_manager' (4a255870-36a8-4187-8240-ce0396110ace) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:31:55 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-8aa7290e-c936-408f-a0dd-0c610874a983 tempest-VolumesGetTest-1244886629 None] Created volume successfully. Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Flow 'volume_create_manager' (78f75819-34bc-466a-adf8-31bb7c0e9556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7e80af-3bcd-42ad-9587-a260b17ac908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7e80af-3bcd-42ad-9587-a260b17ac908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-318684146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4f9396b-0b65-40b8-89e2-f97df7daa1e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4605eea831a548b894081a1e5dd1f1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:31:55Z,use_quota=True,user_id='185282f0af5d4f4e84b0df82bb03e2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62faaf42-cc67-44c6-8cb0-21f98a2b0812),volume_type_id=62faaf42-cc67-44c6-8cb0-21f98a2b0812)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0817dc53-c97c-4459-962a-0d59b909d7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0817dc53-c97c-4459-962a-0d59b909d7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (333d8100-7c61-47c4-9c36-7ef206247b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (333d8100-7c61-47c4-9c36-7ef206247b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4f9396b-0b65-40b8-89e2-f97df7daa1e8', 'volume_name': 'volume-b4f9396b-0b65-40b8-89e2-f97df7daa1e8', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e41e87-5a1c-48e0-9b33-f5a1f24fb719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e41e87-5a1c-48e0-9b33-f5a1f24fb719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb8f1ba-86eb-4686-bd39-258d37ecc201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:55 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Volume b4f9396b-0b65-40b8-89e2-f97df7daa1e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4f9396b-0b65-40b8-89e2-f97df7daa1e8', 'volume_size': 1} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-318684146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4f9396b-0b65-40b8-89e2-f97df7daa1e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4605eea831a548b894081a1e5dd1f1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:31:55Z,use_quota=True,user_id='185282f0af5d4f4e84b0df82bb03e2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62faaf42-cc67-44c6-8cb0-21f98a2b0812),volume_type_id=62faaf42-cc67-44c6-8cb0-21f98a2b0812)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Creating volume b4f9396b-0b65-40b8-89e2-f97df7daa1e8 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:31:55 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b4f9396b-0b65-40b8-89e2-f97df7daa1e8 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:55 devstack sudo[94053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b4f9396b-0b65-40b8-89e2-f97df7daa1e8 1073741824 Nov 06 14:31:55 devstack sudo[94053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Flow 'volume_create_manager' (d3e3f3bd-7872-4a8f-94f4-6fa82ef816f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (155be9e6-1184-4126-9816-0d4df3302980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (155be9e6-1184-4126-9816-0d4df3302980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-481265727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e80d0a-6a1d-41a7-9ff7-01443d08916d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4605eea831a548b894081a1e5dd1f1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:31:56Z,use_quota=True,user_id='185282f0af5d4f4e84b0df82bb03e2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b35f78f2-fb39-4c52-890d-415e9dab5f6f),volume_type_id=b35f78f2-fb39-4c52-890d-415e9dab5f6f)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287f6be6-6c2d-45b4-a9b7-4889367dd47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287f6be6-6c2d-45b4-a9b7-4889367dd47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a21d1f-a379-415a-8e13-039822c71b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a21d1f-a379-415a-8e13-039822c71b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81e80d0a-6a1d-41a7-9ff7-01443d08916d', 'volume_name': 'volume-81e80d0a-6a1d-41a7-9ff7-01443d08916d', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55513ec-9c69-423e-a7d7-be0266ecc75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55513ec-9c69-423e-a7d7-be0266ecc75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba8de09-8be9-41de-b577-2807795e51a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:55 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Volume 81e80d0a-6a1d-41a7-9ff7-01443d08916d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81e80d0a-6a1d-41a7-9ff7-01443d08916d', 'volume_size': 1} Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:31:55 devstack sudo[94053]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b4f9396b-0b65-40b8-89e2-f97df7daa1e8 1073741824" returned: 0 in 0.526s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b4f9396b-0b65-40b8-89e2-f97df7daa1e8 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:56 devstack sudo[94059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b4f9396b-0b65-40b8-89e2-f97df7daa1e8 Nov 06 14:31:56 devstack sudo[94059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:56 devstack sudo[94059]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b4f9396b-0b65-40b8-89e2-f97df7daa1e8" returned: 0 in 0.364s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.537s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-481265727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e80d0a-6a1d-41a7-9ff7-01443d08916d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4605eea831a548b894081a1e5dd1f1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:31:56Z,use_quota=True,user_id='185282f0af5d4f4e84b0df82bb03e2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b35f78f2-fb39-4c52-890d-415e9dab5f6f),volume_type_id=b35f78f2-fb39-4c52-890d-415e9dab5f6f)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Creating volume 81e80d0a-6a1d-41a7-9ff7-01443d08916d {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:31:56 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-81e80d0a-6a1d-41a7-9ff7-01443d08916d 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-369f464c-ec0a-4c0d-ab39-5c7e5cc1373c tempest-VolumesGetTest-1244886629 None] Acquiring lock "cinder-5dc3e894-7d83-4f83-ae55-35f22055b099-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb8f1ba-86eb-4686-bd39-258d37ecc201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4f9396b-0b65-40b8-89e2-f97df7daa1e8', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:56 devstack sudo[94062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-81e80d0a-6a1d-41a7-9ff7-01443d08916d 1073741824 Nov 06 14:31:56 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (793b1023-c4ce-44c6-995e-4ac0d9fc32f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:56 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Volume volume-b4f9396b-0b65-40b8-89e2-f97df7daa1e8 (b4f9396b-0b65-40b8-89e2-f97df7daa1e8): created successfully Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (793b1023-c4ce-44c6-995e-4ac0d9fc32f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Flow 'volume_create_manager' (78f75819-34bc-466a-adf8-31bb7c0e9556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:31:56 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-d9019c22-29d0-41cd-a402-5e1cdcd076c6 tempest-TestInstancesWithCinderVolumes-693752400 None] Created volume successfully. Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-369f464c-ec0a-4c0d-ab39-5c7e5cc1373c tempest-VolumesGetTest-1244886629 None] Lock "cinder-5dc3e894-7d83-4f83-ae55-35f22055b099-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Flow 'volume_create_manager' (ce6395ce-82cb-4889-b38a-06a669e26f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a99b37d-d961-4322-84cd-2ee58db311e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a99b37d-d961-4322-84cd-2ee58db311e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2014893755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=788ac09b-0d57-48eb-a0b6-96c5e7fe286f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4605eea831a548b894081a1e5dd1f1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:31:56Z,use_quota=True,user_id='185282f0af5d4f4e84b0df82bb03e2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f23e656-c6c1-4ea9-a2ff-559f07d58d65),volume_type_id=8f23e656-c6c1-4ea9-a2ff-559f07d58d65)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6a67c6d-b3e1-418c-b7ee-0505d717a21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6a67c6d-b3e1-418c-b7ee-0505d717a21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc707503-32fa-4ff8-b1c1-d06fd8a5347c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG cinder.image.glance [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Creating Keystone auth plugin from conf {{(pid=86854) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-369f464c-ec0a-4c0d-ab39-5c7e5cc1373c tempest-VolumesGetTest-1244886629 None] Acquiring lock "cinder-quobyte-5dc3e894-7d83-4f83-ae55-35f22055b099" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-369f464c-ec0a-4c0d-ab39-5c7e5cc1373c tempest-VolumesGetTest-1244886629 None] Lock "cinder-quobyte-5dc3e894-7d83-4f83-ae55-35f22055b099" acquired by "delete_volume" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a18d36-0a71-48f3-bd7a-29bccd55dfe9]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-369f464c-ec0a-4c0d-ab39-5c7e5cc1373c tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5dc3e894-7d83-4f83-ae55-35f22055b099 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:56 devstack sudo[94067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5dc3e894-7d83-4f83-ae55-35f22055b099 Nov 06 14:31:56 devstack sudo[94067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc707503-32fa-4ff8-b1c1-d06fd8a5347c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '788ac09b-0d57-48eb-a0b6-96c5e7fe286f', 'volume_name': 'volume-788ac09b-0d57-48eb-a0b6-96c5e7fe286f', 'volume_size': 1, 'image_id': '365a7bf5-99b3-4782-b11d-3fe198fb66ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/365a7bf5-99b3-4782-b11d-3fe198fb66ae', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1360856822', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4605eea831a548b894081a1e5dd1f1d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '365a7bf5-99b3-4782-b11d-3fe198fb66ae', 'created_at': datetime.datetime(2026, 11, 6, 13, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 31, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/365a7bf5-99b3-4782-b11d-3fe198fb66ae/file', 'properties': {}}, 'image_service': }' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb3fee3-e870-49c5-89d8-131b348e2947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb3fee3-e870-49c5-89d8-131b348e2947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77562361-971a-48f3-8974-8bf2e7a8a9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:56 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Volume 788ac09b-0d57-48eb-a0b6-96c5e7fe286f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-788ac09b-0d57-48eb-a0b6-96c5e7fe286f', 'volume_size': 1, 'image_id': '365a7bf5-99b3-4782-b11d-3fe198fb66ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/365a7bf5-99b3-4782-b11d-3fe198fb66ae', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1360856822', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4605eea831a548b894081a1e5dd1f1d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '365a7bf5-99b3-4782-b11d-3fe198fb66ae', 'created_at': datetime.datetime(2026, 11, 6, 13, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 31, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/365a7bf5-99b3-4782-b11d-3fe198fb66ae/file', 'properties': {}}, 'image_service': } Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Trying to clone 788ac09b-0d57-48eb-a0b6-96c5e7fe286f from image 365a7bf5-99b3-4782-b11d-3fe198fb66ae at location (None, [{'url': 'file:///opt/stack/data/glance/images/365a7bf5-99b3-4782-b11d-3fe198fb66ae', 'metadata': {}}]). {{(pid=86854) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 14:31:56 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-81e80d0a-6a1d-41a7-9ff7-01443d08916d 1073741824" returned: 0 in 0.530s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-81e80d0a-6a1d-41a7-9ff7-01443d08916d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:57 devstack sudo[94070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-81e80d0a-6a1d-41a7-9ff7-01443d08916d Nov 06 14:31:57 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:57 devstack sudo[94067]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-369f464c-ec0a-4c0d-ab39-5c7e5cc1373c tempest-VolumesGetTest-1244886629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5dc3e894-7d83-4f83-ae55-35f22055b099" returned: 0 in 0.445s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-369f464c-ec0a-4c0d-ab39-5c7e5cc1373c tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5dc3e894-7d83-4f83-ae55-35f22055b099 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:57 devstack sudo[94077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5dc3e894-7d83-4f83-ae55-35f22055b099 Nov 06 14:31:57 devstack sudo[94077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:57 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-81e80d0a-6a1d-41a7-9ff7-01443d08916d" returned: 0 in 0.306s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:57 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:31:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:31:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba8de09-8be9-41de-b577-2807795e51a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81e80d0a-6a1d-41a7-9ff7-01443d08916d', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5672bb5a-7215-40d9-93a4-42eb175ce9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:57 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Volume volume-81e80d0a-6a1d-41a7-9ff7-01443d08916d (81e80d0a-6a1d-41a7-9ff7-01443d08916d): created successfully Nov 06 14:31:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5672bb5a-7215-40d9-93a4-42eb175ce9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Flow 'volume_create_manager' (d3e3f3bd-7872-4a8f-94f4-6fa82ef816f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:31:57 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-4ae36103-dcb8-4a04-883b-e74aa1e044b8 tempest-TestInstancesWithCinderVolumes-693752400 None] Created volume successfully. Nov 06 14:31:57 devstack sudo[94077]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-369f464c-ec0a-4c0d-ab39-5c7e5cc1373c tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5dc3e894-7d83-4f83-ae55-35f22055b099" returned: 0 in 0.314s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:57 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-369f464c-ec0a-4c0d-ab39-5c7e5cc1373c tempest-VolumesGetTest-1244886629 None] Lock "cinder-quobyte-5dc3e894-7d83-4f83-ae55-35f22055b099" released by "delete_volume" :: held 0.812s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:31:57 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-369f464c-ec0a-4c0d-ab39-5c7e5cc1373c tempest-VolumesGetTest-1244886629 None] Created reservations ['b60c701f-6c9c-44a7-940a-ce3b663c506a', '4fe08d02-130f-4444-8834-60ace4f30148', '12e0e8f0-0879-4fb9-8289-065a7e8cd968', 'd529725a-227b-470e-ade4-5101279918d6'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:31:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-369f464c-ec0a-4c0d-ab39-5c7e5cc1373c tempest-VolumesGetTest-1244886629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:31:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-369f464c-ec0a-4c0d-ab39-5c7e5cc1373c tempest-VolumesGetTest-1244886629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:31:57 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-369f464c-ec0a-4c0d-ab39-5c7e5cc1373c tempest-VolumesGetTest-1244886629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:31:57 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-369f464c-ec0a-4c0d-ab39-5c7e5cc1373c tempest-VolumesGetTest-1244886629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:31:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-369f464c-ec0a-4c0d-ab39-5c7e5cc1373c tempest-VolumesGetTest-1244886629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:31:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-369f464c-ec0a-4c0d-ab39-5c7e5cc1373c tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:57 devstack sudo[94087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:31:57 devstack sudo[94087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:57 devstack sudo[94087]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-369f464c-ec0a-4c0d-ab39-5c7e5cc1373c tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.279s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:57 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-369f464c-ec0a-4c0d-ab39-5c7e5cc1373c tempest-VolumesGetTest-1244886629 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:31:57 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-369f464c-ec0a-4c0d-ab39-5c7e5cc1373c tempest-VolumesGetTest-1244886629 None] Deleted volume successfully. Nov 06 14:31:57 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-369f464c-ec0a-4c0d-ab39-5c7e5cc1373c tempest-VolumesGetTest-1244886629 None] Lock "cinder-5dc3e894-7d83-4f83-ae55-35f22055b099-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Flow 'volume_create_manager' (a54c4fa5-0253-4820-bcb0-05c2eb5a5c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6fb8764-ed92-4c1d-b2a8-11aaa574b188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6fb8764-ed92-4c1d-b2a8-11aaa574b188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-987634861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8598ff0a-a2e4-47f8-9fba-79444eadc147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aed039f1ea3d4670bcad85a8c900161a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:31:58Z,use_quota=True,user_id='1e321f974dc0481b8f0e197a711d632f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7ab5aa9-fbe9-450f-994a-26461623af06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7ab5aa9-fbe9-450f-994a-26461623af06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6c0c4da-4453-437f-92db-d701f46f2eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6c0c4da-4453-437f-92db-d701f46f2eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8598ff0a-a2e4-47f8-9fba-79444eadc147', 'volume_name': 'volume-8598ff0a-a2e4-47f8-9fba-79444eadc147', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (729bf8e8-f84e-4fea-8291-cadd18254035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (729bf8e8-f84e-4fea-8291-cadd18254035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2138a041-016b-4337-9450-e0239d209130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:58 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Volume 8598ff0a-a2e4-47f8-9fba-79444eadc147: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8598ff0a-a2e4-47f8-9fba-79444eadc147', 'volume_size': 1} Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-987634861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8598ff0a-a2e4-47f8-9fba-79444eadc147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aed039f1ea3d4670bcad85a8c900161a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:31:58Z,use_quota=True,user_id='1e321f974dc0481b8f0e197a711d632f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Creating volume 8598ff0a-a2e4-47f8-9fba-79444eadc147 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:31:58 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8598ff0a-a2e4-47f8-9fba-79444eadc147 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:58 devstack sudo[94090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8598ff0a-a2e4-47f8-9fba-79444eadc147 1073741824 Nov 06 14:31:58 devstack sudo[94090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:58 devstack sudo[94090]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8598ff0a-a2e4-47f8-9fba-79444eadc147 1073741824" returned: 0 in 0.529s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c2058274-9de0-464d-8034-bfe7c82b249f tempest-VolumesGetTest-1244886629 None] Acquiring lock "cinder-0528c731-5b66-47ad-a7de-23e956b7f54e-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8598ff0a-a2e4-47f8-9fba-79444eadc147 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c2058274-9de0-464d-8034-bfe7c82b249f tempest-VolumesGetTest-1244886629 None] Lock "cinder-0528c731-5b66-47ad-a7de-23e956b7f54e-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:31:58 devstack sudo[94096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8598ff0a-a2e4-47f8-9fba-79444eadc147 Nov 06 14:31:58 devstack sudo[94096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c2058274-9de0-464d-8034-bfe7c82b249f tempest-VolumesGetTest-1244886629 None] Acquiring lock "cinder-quobyte-0528c731-5b66-47ad-a7de-23e956b7f54e" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c2058274-9de0-464d-8034-bfe7c82b249f tempest-VolumesGetTest-1244886629 None] Lock "cinder-quobyte-0528c731-5b66-47ad-a7de-23e956b7f54e" acquired by "delete_volume" :: waited 0.026s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1492d08-64b2-4ce1-b468-41de102d7a70]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:31:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c2058274-9de0-464d-8034-bfe7c82b249f tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0528c731-5b66-47ad-a7de-23e956b7f54e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:59 devstack sudo[94098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0528c731-5b66-47ad-a7de-23e956b7f54e Nov 06 14:31:59 devstack sudo[94098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:59 devstack sudo[94096]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8598ff0a-a2e4-47f8-9fba-79444eadc147" returned: 0 in 0.356s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:31:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:31:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2138a041-016b-4337-9450-e0239d209130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8598ff0a-a2e4-47f8-9fba-79444eadc147', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59645b82-4228-45bc-97ac-46f88458e98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:31:59 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Volume volume-8598ff0a-a2e4-47f8-9fba-79444eadc147 (8598ff0a-a2e4-47f8-9fba-79444eadc147): created successfully Nov 06 14:31:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59645b82-4228-45bc-97ac-46f88458e98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:31:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Flow 'volume_create_manager' (a54c4fa5-0253-4820-bcb0-05c2eb5a5c56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:31:59 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-4b97b0a0-0fb6-4feb-9302-96fa87f5bdf5 tempest-AttachVolumeTestJSON-100281132 None] Created volume successfully. Nov 06 14:31:59 devstack sudo[94098]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c2058274-9de0-464d-8034-bfe7c82b249f tempest-VolumesGetTest-1244886629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0528c731-5b66-47ad-a7de-23e956b7f54e" returned: 0 in 0.473s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c2058274-9de0-464d-8034-bfe7c82b249f tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0528c731-5b66-47ad-a7de-23e956b7f54e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:59 devstack sudo[94106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0528c731-5b66-47ad-a7de-23e956b7f54e Nov 06 14:31:59 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:31:59 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root Nov 06 14:31:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c2058274-9de0-464d-8034-bfe7c82b249f tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0528c731-5b66-47ad-a7de-23e956b7f54e" returned: 0 in 0.249s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:31:59 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c2058274-9de0-464d-8034-bfe7c82b249f tempest-VolumesGetTest-1244886629 None] Lock "cinder-quobyte-0528c731-5b66-47ad-a7de-23e956b7f54e" released by "delete_volume" :: held 0.796s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:31:59 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-c2058274-9de0-464d-8034-bfe7c82b249f tempest-VolumesGetTest-1244886629 None] Created reservations ['ba1de68e-8817-4ba5-83f9-de1fa221971c', '6abe2e02-73f3-49ec-9bff-61e7cfe1dca6', 'f49522e5-32aa-47b6-a275-680a0fa1f203', '686ac372-e7f8-4a16-bfdc-0c1436273228'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:31:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c2058274-9de0-464d-8034-bfe7c82b249f tempest-VolumesGetTest-1244886629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:31:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c2058274-9de0-464d-8034-bfe7c82b249f tempest-VolumesGetTest-1244886629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:31:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c2058274-9de0-464d-8034-bfe7c82b249f tempest-VolumesGetTest-1244886629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:31:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c2058274-9de0-464d-8034-bfe7c82b249f tempest-VolumesGetTest-1244886629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:31:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c2058274-9de0-464d-8034-bfe7c82b249f tempest-VolumesGetTest-1244886629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:31:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c2058274-9de0-464d-8034-bfe7c82b249f tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:31:59 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:31:59 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8b417a24-b77c-48ef-9ea3-7e877ad21213 tempest-VolumesGetTest-1244886629 None] Acquiring lock "cinder-2de826fa-6c11-4248-8f4a-37a5302076a3-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:32:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8b417a24-b77c-48ef-9ea3-7e877ad21213 tempest-VolumesGetTest-1244886629 None] Lock "cinder-2de826fa-6c11-4248-8f4a-37a5302076a3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:32:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8b417a24-b77c-48ef-9ea3-7e877ad21213 tempest-VolumesGetTest-1244886629 None] Acquiring lock "cinder-quobyte-2de826fa-6c11-4248-8f4a-37a5302076a3" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:32:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8b417a24-b77c-48ef-9ea3-7e877ad21213 tempest-VolumesGetTest-1244886629 None] Lock "cinder-quobyte-2de826fa-6c11-4248-8f4a-37a5302076a3" acquired by "delete_volume" :: waited 0.025s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:32:00 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c2058274-9de0-464d-8034-bfe7c82b249f tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.379s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:00 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-c2058274-9de0-464d-8034-bfe7c82b249f tempest-VolumesGetTest-1244886629 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:32:00 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-c2058274-9de0-464d-8034-bfe7c82b249f tempest-VolumesGetTest-1244886629 None] Deleted volume successfully. Nov 06 14:32:00 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ec6aa2-ba9e-453f-9161-aad3cf4eaa22]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:32:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8b417a24-b77c-48ef-9ea3-7e877ad21213 tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c2058274-9de0-464d-8034-bfe7c82b249f tempest-VolumesGetTest-1244886629 None] Lock "cinder-0528c731-5b66-47ad-a7de-23e956b7f54e-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:32:00 devstack sudo[94112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3 Nov 06 14:32:00 devstack sudo[94112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:00 devstack sudo[94112]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8b417a24-b77c-48ef-9ea3-7e877ad21213 tempest-VolumesGetTest-1244886629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3" returned: 0 in 0.521s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8b417a24-b77c-48ef-9ea3-7e877ad21213 tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:00 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3 Nov 06 14:32:00 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:01 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8b417a24-b77c-48ef-9ea3-7e877ad21213 tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2de826fa-6c11-4248-8f4a-37a5302076a3" returned: 0 in 0.269s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8b417a24-b77c-48ef-9ea3-7e877ad21213 tempest-VolumesGetTest-1244886629 None] Lock "cinder-quobyte-2de826fa-6c11-4248-8f4a-37a5302076a3" released by "delete_volume" :: held 0.880s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:32:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-338a2ac8-3db0-453a-bf9d-021c321924b5 req-7c4d2777-3c5b-4ed1-9c5a-812e337c6988 tempest-AttachVolumeTestJSON-100281132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:32:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-338a2ac8-3db0-453a-bf9d-021c321924b5 req-7c4d2777-3c5b-4ed1-9c5a-812e337c6988 tempest-AttachVolumeTestJSON-100281132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:32:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-338a2ac8-3db0-453a-bf9d-021c321924b5 req-7c4d2777-3c5b-4ed1-9c5a-812e337c6988 tempest-AttachVolumeTestJSON-100281132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:32:01 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-8b417a24-b77c-48ef-9ea3-7e877ad21213 tempest-VolumesGetTest-1244886629 None] Created reservations ['9c31e28a-1f90-4bfd-adcd-16df8cb6fb2a', 'b5136ab9-099c-44a9-b955-561c4a32048e', '9fc70d51-061a-4b2c-8c52-96196dc4068e', '9f150e93-8cdb-4889-a33d-7a12d21cec41'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:32:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-338a2ac8-3db0-453a-bf9d-021c321924b5 req-7c4d2777-3c5b-4ed1-9c5a-812e337c6988 tempest-AttachVolumeTestJSON-100281132 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e', 'name': 'volume-8598ff0a-a2e4-47f8-9fba-79444eadc147', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'de04132e-7ac4-42cb-89e2-f7261f78665c', 'enforce_multipath': True} {{(pid=86854) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 14:32:01 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-338a2ac8-3db0-453a-bf9d-021c321924b5 req-7c4d2777-3c5b-4ed1-9c5a-812e337c6988 tempest-AttachVolumeTestJSON-100281132 None] attachment_update completed successfully. Nov 06 14:32:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8b417a24-b77c-48ef-9ea3-7e877ad21213 tempest-VolumesGetTest-1244886629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:32:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8b417a24-b77c-48ef-9ea3-7e877ad21213 tempest-VolumesGetTest-1244886629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:32:01 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8b417a24-b77c-48ef-9ea3-7e877ad21213 tempest-VolumesGetTest-1244886629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:32:01 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8b417a24-b77c-48ef-9ea3-7e877ad21213 tempest-VolumesGetTest-1244886629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:32:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8b417a24-b77c-48ef-9ea3-7e877ad21213 tempest-VolumesGetTest-1244886629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:32:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8b417a24-b77c-48ef-9ea3-7e877ad21213 tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:01 devstack sudo[94148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:32:01 devstack sudo[94148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:01 devstack sudo[94148]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8b417a24-b77c-48ef-9ea3-7e877ad21213 tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.345s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:01 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-8b417a24-b77c-48ef-9ea3-7e877ad21213 tempest-VolumesGetTest-1244886629 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:32:01 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-8b417a24-b77c-48ef-9ea3-7e877ad21213 tempest-VolumesGetTest-1244886629 None] Deleted volume successfully. Nov 06 14:32:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8b417a24-b77c-48ef-9ea3-7e877ad21213 tempest-VolumesGetTest-1244886629 None] Lock "cinder-2de826fa-6c11-4248-8f4a-37a5302076a3-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:32:02 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_365a7bf5-99b3-4782-b11d-3fe198fb66ae_tmj77zr6devstack@QuobyteHD, size 20.69 MB, duration 5.15 sec {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 14:32:02 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Image download 20.69 MB at 4.02 MB/s Nov 06 14:32:02 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[1804f4a2-ee29-4b15-b316-9012c09ad18a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:32:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_365a7bf5-99b3-4782-b11d-3fe198fb66ae_tmj77zr6devstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:02 devstack sudo[94153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_365a7bf5-99b3-4782-b11d-3fe198fb66ae_tmj77zr6devstack@QuobyteHD Nov 06 14:32:02 devstack sudo[94153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:02 devstack sudo[94153]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_365a7bf5-99b3-4782-b11d-3fe198fb66ae_tmj77zr6devstack@QuobyteHD" returned: 0 in 0.532s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:02 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Temporary image 365a7bf5-99b3-4782-b11d-3fe198fb66ae is fetched for user 185282f0af5d4f4e84b0df82bb03e2b6. {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 14:32:02 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4195b8-e587-4ce5-abcd-911fc2c9cc02]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:32:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_365a7bf5-99b3-4782-b11d-3fe198fb66ae_tmj77zr6devstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:02 devstack sudo[94203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_365a7bf5-99b3-4782-b11d-3fe198fb66ae_tmj77zr6devstack@QuobyteHD Nov 06 14:32:02 devstack sudo[94203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:03 devstack sudo[94203]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_365a7bf5-99b3-4782-b11d-3fe198fb66ae_tmj77zr6devstack@QuobyteHD" returned: 0 in 0.433s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:32:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:32:03 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2014893755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=788ac09b-0d57-48eb-a0b6-96c5e7fe286f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4605eea831a548b894081a1e5dd1f1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:31:56Z,use_quota=True,user_id='185282f0af5d4f4e84b0df82bb03e2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f23e656-c6c1-4ea9-a2ff-559f07d58d65),volume_type_id=8f23e656-c6c1-4ea9-a2ff-559f07d58d65)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:32:03 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Creating volume 788ac09b-0d57-48eb-a0b6-96c5e7fe286f {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:32:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:32:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:32:03 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:32:03 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:32:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:32:03 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:32:03 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:32:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-788ac09b-0d57-48eb-a0b6-96c5e7fe286f 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:03 devstack sudo[94209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-788ac09b-0d57-48eb-a0b6-96c5e7fe286f 1073741824 Nov 06 14:32:03 devstack sudo[94209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:03 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:32:03 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Flow 'volume_create_manager' (68583a75-7cd9-4cd5-bafd-c96bf562ef85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:32:03 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9f6acf-2972-435d-9483-e05a48b77881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:32:03 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9f6acf-2972-435d-9483-e05a48b77881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1662227066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d4a4b38-2c5a-4c45-873d-d5faee2e8598,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3ddb34a0bd44464c9f3c8c1e91372fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:32:04Z,use_quota=True,user_id='a16623f4615c49c79407ce9eb7add66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:32:03 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f190c7a-a53a-4040-b699-52ae69232549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:32:03 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f190c7a-a53a-4040-b699-52ae69232549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:32:03 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7793c0e3-8cc7-455a-bcb4-67dd93031ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:32:03 devstack cinder-volume[86854]: DEBUG cinder.image.glance [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Creating Keystone auth plugin from conf {{(pid=86854) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 14:32:03 devstack sudo[94209]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-788ac09b-0d57-48eb-a0b6-96c5e7fe286f 1073741824" returned: 0 in 0.728s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-788ac09b-0d57-48eb-a0b6-96c5e7fe286f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:04 devstack sudo[94238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-788ac09b-0d57-48eb-a0b6-96c5e7fe286f Nov 06 14:32:04 devstack sudo[94238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7793c0e3-8cc7-455a-bcb4-67dd93031ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9d4a4b38-2c5a-4c45-873d-d5faee2e8598', 'volume_name': 'volume-9d4a4b38-2c5a-4c45-873d-d5faee2e8598', 'volume_size': 1, 'image_id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15767f46df214a0b8fce21735120de72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'created_at': datetime.datetime(2026, 11, 6, 13, 20, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 20, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0e99-e622-4342-8eb8-14122332c9ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:32:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71144c7c-41d3-442c-95f3-3a9ee6654e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:32:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71144c7c-41d3-442c-95f3-3a9ee6654e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:32:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6de5929-4f1b-4d66-b8d0-5a28d88130a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:32:04 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Volume 9d4a4b38-2c5a-4c45-873d-d5faee2e8598: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9d4a4b38-2c5a-4c45-873d-d5faee2e8598', 'volume_size': 1, 'image_id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15767f46df214a0b8fce21735120de72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'created_at': datetime.datetime(2026, 11, 6, 13, 20, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 20, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0e99-e622-4342-8eb8-14122332c9ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 14:32:04 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Trying to clone 9d4a4b38-2c5a-4c45-873d-d5faee2e8598 from image 918d0e99-e622-4342-8eb8-14122332c9ca at location (None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}]). {{(pid=86854) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 14:32:04 devstack sudo[94238]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-788ac09b-0d57-48eb-a0b6-96c5e7fe286f" returned: 0 in 0.461s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:04 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:32:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:32:04 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Attempting download of 365a7bf5-99b3-4782-b11d-3fe198fb66ae ((None, [{'url': 'file:///opt/stack/data/glance/images/365a7bf5-99b3-4782-b11d-3fe198fb66ae', 'metadata': {}}])) to volume 788ac09b-0d57-48eb-a0b6-96c5e7fe286f. {{(pid=86854) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 14:32:04 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d578b0-7da5-4443-955a-02c6937c6ac6]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:32:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_365a7bf5-99b3-4782-b11d-3fe198fb66ae_fphye2ta {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:04 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_3tzrj58wdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 14:32:04 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Image download 20.69 MB at 20.69 MB/s Nov 06 14:32:04 devstack sudo[94244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_365a7bf5-99b3-4782-b11d-3fe198fb66ae_fphye2ta Nov 06 14:32:04 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:04 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c74cdbd-776b-4e32-8c58-b68e9ac19c61]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:32:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_3tzrj58wdevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:05 devstack sudo[94246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_3tzrj58wdevstack@QuobyteHD Nov 06 14:32:05 devstack sudo[94246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:05 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_365a7bf5-99b3-4782-b11d-3fe198fb66ae_fphye2ta" returned: 0 in 0.469s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_365a7bf5-99b3-4782-b11d-3fe198fb66ae_fphye2ta {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:05 devstack sudo[94246]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_3tzrj58wdevstack@QuobyteHD" returned: 0 in 0.476s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:05 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Temporary image 918d0e99-e622-4342-8eb8-14122332c9ca is fetched for user a16623f4615c49c79407ce9eb7add66e. {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 14:32:05 devstack sudo[94251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_365a7bf5-99b3-4782-b11d-3fe198fb66ae_fphye2ta Nov 06 14:32:05 devstack sudo[94251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:05 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fcc019-5142-4e25-965d-f4ded47d90f3]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:32:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_3tzrj58wdevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:05 devstack sudo[94257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_3tzrj58wdevstack@QuobyteHD Nov 06 14:32:05 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:05 devstack sudo[94251]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_365a7bf5-99b3-4782-b11d-3fe198fb66ae_fphye2ta" returned: 1 in 0.425s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_365a7bf5-99b3-4782-b11d-3fe198fb66ae_fphye2ta' failed. Not Retrying. {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 14:32:05 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[792c47eb-7b05-4758-8834-399d61ecbb9d]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:32:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_365a7bf5-99b3-4782-b11d-3fe198fb66ae_tmj77zr6devstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:05 devstack sudo[94261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_365a7bf5-99b3-4782-b11d-3fe198fb66ae_tmj77zr6devstack@QuobyteHD Nov 06 14:32:05 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:05 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-df52a10b-4c38-48e5-9a56-3139e2e0fbbd req-c13ff6ab-1804-490b-a0c7-4292170f6dde tempest-ServerActionsTestOtherA-1610590813 None] Terminate volume connection completed successfully. Nov 06 14:32:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-df52a10b-4c38-48e5-9a56-3139e2e0fbbd req-c13ff6ab-1804-490b-a0c7-4292170f6dde tempest-ServerActionsTestOtherA-1610590813 None] Deleting attachment bf23a755-44cc-4ae2-96a3-183e98ebf3f1. {{(pid=86854) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 14:32:06 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_3tzrj58wdevstack@QuobyteHD" returned: 0 in 0.599s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:32:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:32:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1662227066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d4a4b38-2c5a-4c45-873d-d5faee2e8598,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3ddb34a0bd44464c9f3c8c1e91372fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:32:04Z,use_quota=True,user_id='a16623f4615c49c79407ce9eb7add66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:32:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Creating volume 9d4a4b38-2c5a-4c45-873d-d5faee2e8598 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:32:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:32:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:32:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:32:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:32:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:32:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:32:06 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:32:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9d4a4b38-2c5a-4c45-873d-d5faee2e8598 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:06 devstack sudo[94279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9d4a4b38-2c5a-4c45-873d-d5faee2e8598 1073741824 Nov 06 14:32:06 devstack sudo[94279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:06 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-df52a10b-4c38-48e5-9a56-3139e2e0fbbd req-3b9fe4ca-524a-491e-b978-153d38253ae0 tempest-ServerActionsTestOtherA-1610590813 None] Acquiring lock "cinder-e7d497f6-f98c-443f-8535-9398feb12a27-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:32:06 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-df52a10b-4c38-48e5-9a56-3139e2e0fbbd req-3b9fe4ca-524a-491e-b978-153d38253ae0 tempest-ServerActionsTestOtherA-1610590813 None] Lock "cinder-e7d497f6-f98c-443f-8535-9398feb12a27-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:32:06 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-df52a10b-4c38-48e5-9a56-3139e2e0fbbd req-3b9fe4ca-524a-491e-b978-153d38253ae0 tempest-ServerActionsTestOtherA-1610590813 None] Acquiring lock "cinder-quobyte-e7d497f6-f98c-443f-8535-9398feb12a27" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:32:06 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_365a7bf5-99b3-4782-b11d-3fe198fb66ae_tmj77zr6devstack@QuobyteHD" returned: 0 in 0.655s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:06 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] 365a7bf5-99b3-4782-b11d-3fe198fb66ae was qcow2, converting to qcow2 {{(pid=86854) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 14:32:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_365a7bf5-99b3-4782-b11d-3fe198fb66ae_tmj77zr6devstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-788ac09b-0d57-48eb-a0b6-96c5e7fe286f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:06 devstack sudo[94311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_365a7bf5-99b3-4782-b11d-3fe198fb66ae_tmj77zr6devstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-788ac09b-0d57-48eb-a0b6-96c5e7fe286f Nov 06 14:32:06 devstack sudo[94311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:06 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-df52a10b-4c38-48e5-9a56-3139e2e0fbbd req-3b9fe4ca-524a-491e-b978-153d38253ae0 tempest-ServerActionsTestOtherA-1610590813 None] Lock "cinder-quobyte-e7d497f6-f98c-443f-8535-9398feb12a27" acquired by "delete_volume" :: waited 0.088s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:32:06 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[c172ee35-4a9c-454b-9dd6-9fc0e2c98a55]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:32:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-df52a10b-4c38-48e5-9a56-3139e2e0fbbd req-3b9fe4ca-524a-491e-b978-153d38253ae0 tempest-ServerActionsTestOtherA-1610590813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e7d497f6-f98c-443f-8535-9398feb12a27 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:06 devstack sudo[94355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e7d497f6-f98c-443f-8535-9398feb12a27 Nov 06 14:32:06 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:07 devstack sudo[94279]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9d4a4b38-2c5a-4c45-873d-d5faee2e8598 1073741824" returned: 0 in 0.955s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:07 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-df52a10b-4c38-48e5-9a56-3139e2e0fbbd req-3b9fe4ca-524a-491e-b978-153d38253ae0 tempest-ServerActionsTestOtherA-1610590813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e7d497f6-f98c-443f-8535-9398feb12a27" returned: 0 in 0.621s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-df52a10b-4c38-48e5-9a56-3139e2e0fbbd req-3b9fe4ca-524a-491e-b978-153d38253ae0 tempest-ServerActionsTestOtherA-1610590813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e7d497f6-f98c-443f-8535-9398feb12a27 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9d4a4b38-2c5a-4c45-873d-d5faee2e8598 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:07 devstack sudo[94416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e7d497f6-f98c-443f-8535-9398feb12a27 Nov 06 14:32:07 devstack sudo[94416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:07 devstack sudo[94419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9d4a4b38-2c5a-4c45-873d-d5faee2e8598 Nov 06 14:32:07 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:07 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9d4a4b38-2c5a-4c45-873d-d5faee2e8598" returned: 0 in 0.339s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:07 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:32:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.397s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:32:07 devstack sudo[94416]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:07 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Attempting download of 918d0e99-e622-4342-8eb8-14122332c9ca ((None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}])) to volume 9d4a4b38-2c5a-4c45-873d-d5faee2e8598. {{(pid=86854) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 14:32:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-df52a10b-4c38-48e5-9a56-3139e2e0fbbd req-3b9fe4ca-524a-491e-b978-153d38253ae0 tempest-ServerActionsTestOtherA-1610590813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e7d497f6-f98c-443f-8535-9398feb12a27" returned: 0 in 0.437s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:07 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-df52a10b-4c38-48e5-9a56-3139e2e0fbbd req-3b9fe4ca-524a-491e-b978-153d38253ae0 tempest-ServerActionsTestOtherA-1610590813 None] Lock "cinder-quobyte-e7d497f6-f98c-443f-8535-9398feb12a27" released by "delete_volume" :: held 1.169s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:32:07 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88cd072-113c-4278-a409-2b179edc0e66]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:32:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_56i50uid {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:07 devstack cinder-volume[86854]: DEBUG cinder.quota [req-df52a10b-4c38-48e5-9a56-3139e2e0fbbd req-3b9fe4ca-524a-491e-b978-153d38253ae0 tempest-ServerActionsTestOtherA-1610590813 None] Created reservations ['b50606a1-0bdb-445e-b8ae-0b76bb63e055', '3359f820-e71f-413f-a3aa-ffc171415e97', '47172b55-4792-4213-9ea3-0ed837493af9', '27f94578-7c1a-4c58-969f-e68370783b10'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:32:07 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-08e17bb4-adf0-4fa5-b509-ee0186d21906 tempest-ServerActionsTestOtherA-1610590813 None] Acquiring lock "cinder-e363f1a1-7198-4c78-bc8a-e8a8feb1815d-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:32:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-df52a10b-4c38-48e5-9a56-3139e2e0fbbd req-3b9fe4ca-524a-491e-b978-153d38253ae0 tempest-ServerActionsTestOtherA-1610590813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:32:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-df52a10b-4c38-48e5-9a56-3139e2e0fbbd req-3b9fe4ca-524a-491e-b978-153d38253ae0 tempest-ServerActionsTestOtherA-1610590813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:32:07 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [req-df52a10b-4c38-48e5-9a56-3139e2e0fbbd req-3b9fe4ca-524a-491e-b978-153d38253ae0 tempest-ServerActionsTestOtherA-1610590813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:32:08 devstack sudo[94433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_56i50uid Nov 06 14:32:08 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:08 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [req-df52a10b-4c38-48e5-9a56-3139e2e0fbbd req-3b9fe4ca-524a-491e-b978-153d38253ae0 tempest-ServerActionsTestOtherA-1610590813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:32:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-df52a10b-4c38-48e5-9a56-3139e2e0fbbd req-3b9fe4ca-524a-491e-b978-153d38253ae0 tempest-ServerActionsTestOtherA-1610590813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:32:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-df52a10b-4c38-48e5-9a56-3139e2e0fbbd req-3b9fe4ca-524a-491e-b978-153d38253ae0 tempest-ServerActionsTestOtherA-1610590813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:08 devstack sudo[94781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:32:08 devstack sudo[94781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:08 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-08e17bb4-adf0-4fa5-b509-ee0186d21906 tempest-ServerActionsTestOtherA-1610590813 None] Lock "cinder-e363f1a1-7198-4c78-bc8a-e8a8feb1815d-delete_volume" acquired by "delete_volume" :: waited 0.230s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:32:08 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-08e17bb4-adf0-4fa5-b509-ee0186d21906 tempest-ServerActionsTestOtherA-1610590813 None] Acquiring lock "cinder-quobyte-e363f1a1-7198-4c78-bc8a-e8a8feb1815d" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:32:08 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-08e17bb4-adf0-4fa5-b509-ee0186d21906 tempest-ServerActionsTestOtherA-1610590813 None] Lock "cinder-quobyte-e363f1a1-7198-4c78-bc8a-e8a8feb1815d" acquired by "delete_volume" :: waited 0.074s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:32:08 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4c39f0-0e17-4787-b4fb-6976fb1ad2e3]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:32:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-08e17bb4-adf0-4fa5-b509-ee0186d21906 tempest-ServerActionsTestOtherA-1610590813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e363f1a1-7198-4c78-bc8a-e8a8feb1815d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:08 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_56i50uid" returned: 0 in 0.899s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_56i50uid {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:08 devstack sudo[94781]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-df52a10b-4c38-48e5-9a56-3139e2e0fbbd req-3b9fe4ca-524a-491e-b978-153d38253ae0 tempest-ServerActionsTestOtherA-1610590813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.585s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:08 devstack cinder-volume[86854]: DEBUG cinder.manager [req-df52a10b-4c38-48e5-9a56-3139e2e0fbbd req-3b9fe4ca-524a-491e-b978-153d38253ae0 tempest-ServerActionsTestOtherA-1610590813 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:32:08 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-df52a10b-4c38-48e5-9a56-3139e2e0fbbd req-3b9fe4ca-524a-491e-b978-153d38253ae0 tempest-ServerActionsTestOtherA-1610590813 None] Deleted volume successfully. Nov 06 14:32:08 devstack sudo[94798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e363f1a1-7198-4c78-bc8a-e8a8feb1815d Nov 06 14:32:08 devstack sudo[94798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:08 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-df52a10b-4c38-48e5-9a56-3139e2e0fbbd req-3b9fe4ca-524a-491e-b978-153d38253ae0 tempest-ServerActionsTestOtherA-1610590813 None] Lock "cinder-e7d497f6-f98c-443f-8535-9398feb12a27-delete_volume" released by "delete_volume" :: held 2.523s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:32:08 devstack sudo[94802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_56i50uid Nov 06 14:32:08 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:09 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_56i50uid" returned: 1 in 0.871s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_56i50uid' failed. Not Retrying. {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 14:32:09 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f7119d-210b-43b6-9e65-deebe03c7109]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:32:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_3tzrj58wdevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:09 devstack sudo[94798]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-08e17bb4-adf0-4fa5-b509-ee0186d21906 tempest-ServerActionsTestOtherA-1610590813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e363f1a1-7198-4c78-bc8a-e8a8feb1815d" returned: 0 in 1.000s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-08e17bb4-adf0-4fa5-b509-ee0186d21906 tempest-ServerActionsTestOtherA-1610590813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e363f1a1-7198-4c78-bc8a-e8a8feb1815d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:09 devstack sudo[94838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e363f1a1-7198-4c78-bc8a-e8a8feb1815d Nov 06 14:32:09 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:09 devstack sudo[94837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_3tzrj58wdevstack@QuobyteHD Nov 06 14:32:09 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:09 devstack sudo[94311]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_365a7bf5-99b3-4782-b11d-3fe198fb66ae_tmj77zr6devstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-788ac09b-0d57-48eb-a0b6-96c5e7fe286f" returned: 0 in 3.447s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:09 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_365a7bf5-99b3-4782-b11d-3fe198fb66ae_tmj77zr6devstack@QuobyteHD, size 112.00 MB, duration 3.45 sec, destination /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-788ac09b-0d57-48eb-a0b6-96c5e7fe286f {{(pid=86854) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 14:32:09 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Converted 112.00 MB image at 32.43 MB/s Nov 06 14:32:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-788ac09b-0d57-48eb-a0b6-96c5e7fe286f 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:09 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-08e17bb4-adf0-4fa5-b509-ee0186d21906 tempest-ServerActionsTestOtherA-1610590813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e363f1a1-7198-4c78-bc8a-e8a8feb1815d" returned: 0 in 0.402s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:09 devstack sudo[94850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-788ac09b-0d57-48eb-a0b6-96c5e7fe286f 1G Nov 06 14:32:09 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-08e17bb4-adf0-4fa5-b509-ee0186d21906 tempest-ServerActionsTestOtherA-1610590813 None] Lock "cinder-quobyte-e363f1a1-7198-4c78-bc8a-e8a8feb1815d" released by "delete_volume" :: held 1.527s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:32:10 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-08e17bb4-adf0-4fa5-b509-ee0186d21906 tempest-ServerActionsTestOtherA-1610590813 None] Created reservations ['1aabb7ba-4f90-4e75-a8b1-dcb9ba3d6467', 'd4dc4356-8062-417e-bf90-63d8e4d96dd0', 'dd663bc3-1c12-4378-b252-4aaa39ea744a', '40d7a8c6-62a5-4570-a662-a28601aabd46'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:32:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-08e17bb4-adf0-4fa5-b509-ee0186d21906 tempest-ServerActionsTestOtherA-1610590813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:32:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-08e17bb4-adf0-4fa5-b509-ee0186d21906 tempest-ServerActionsTestOtherA-1610590813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:32:10 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-08e17bb4-adf0-4fa5-b509-ee0186d21906 tempest-ServerActionsTestOtherA-1610590813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:32:10 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-08e17bb4-adf0-4fa5-b509-ee0186d21906 tempest-ServerActionsTestOtherA-1610590813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:32:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-08e17bb4-adf0-4fa5-b509-ee0186d21906 tempest-ServerActionsTestOtherA-1610590813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:32:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-08e17bb4-adf0-4fa5-b509-ee0186d21906 tempest-ServerActionsTestOtherA-1610590813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:10 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_3tzrj58wdevstack@QuobyteHD" returned: 0 in 0.924s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:10 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] 918d0e99-e622-4342-8eb8-14122332c9ca was qcow2, converting to qcow2 {{(pid=86854) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 14:32:10 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:32:10 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_3tzrj58wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9d4a4b38-2c5a-4c45-873d-d5faee2e8598 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:10 devstack sudo[94859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_3tzrj58wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9d4a4b38-2c5a-4c45-873d-d5faee2e8598 Nov 06 14:32:10 devstack sudo[94859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:10 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-788ac09b-0d57-48eb-a0b6-96c5e7fe286f 1G" returned: 0 in 0.967s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:10 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Downloaded image 365a7bf5-99b3-4782-b11d-3fe198fb66ae ((None, [{'url': 'file:///opt/stack/data/glance/images/365a7bf5-99b3-4782-b11d-3fe198fb66ae', 'metadata': {}}])) to volume 788ac09b-0d57-48eb-a0b6-96c5e7fe286f successfully. {{(pid=86854) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 14:32:10 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Temporary image 365a7bf5-99b3-4782-b11d-3fe198fb66ae for user 185282f0af5d4f4e84b0df82bb03e2b6 is deleted. {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 14:32:10 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Marking volume 788ac09b-0d57-48eb-a0b6-96c5e7fe286f as bootable. {{(pid=86854) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 14:32:10 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Copying metadata from image 365a7bf5-99b3-4782-b11d-3fe198fb66ae to 788ac09b-0d57-48eb-a0b6-96c5e7fe286f. {{(pid=86854) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 14:32:10 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Creating volume glance metadata for volume 788ac09b-0d57-48eb-a0b6-96c5e7fe286f backed by image 365a7bf5-99b3-4782-b11d-3fe198fb66ae with: {'image_id': '365a7bf5-99b3-4782-b11d-3fe198fb66ae', 'image_name': 'tempest-scenario-img--1360856822', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86854) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 14:32:10 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77562361-971a-48f3-8974-8bf2e7a8a9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-788ac09b-0d57-48eb-a0b6-96c5e7fe286f', 'volume_size': 1, 'image_id': '365a7bf5-99b3-4782-b11d-3fe198fb66ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/365a7bf5-99b3-4782-b11d-3fe198fb66ae', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1360856822', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4605eea831a548b894081a1e5dd1f1d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '365a7bf5-99b3-4782-b11d-3fe198fb66ae', 'created_at': datetime.datetime(2026, 11, 6, 13, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 31, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/365a7bf5-99b3-4782-b11d-3fe198fb66ae/file', 'properties': {}}, 'image_service': }' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:32:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54a30e7-d9aa-443b-bf6e-14d333d4bf0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:32:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-08e17bb4-adf0-4fa5-b509-ee0186d21906 tempest-ServerActionsTestOtherA-1610590813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.742s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:11 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-08e17bb4-adf0-4fa5-b509-ee0186d21906 tempest-ServerActionsTestOtherA-1610590813 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:32:11 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-08e17bb4-adf0-4fa5-b509-ee0186d21906 tempest-ServerActionsTestOtherA-1610590813 None] Deleted volume successfully. Nov 06 14:32:11 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Volume volume-788ac09b-0d57-48eb-a0b6-96c5e7fe286f (788ac09b-0d57-48eb-a0b6-96c5e7fe286f): created successfully Nov 06 14:32:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54a30e7-d9aa-443b-bf6e-14d333d4bf0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:32:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Flow 'volume_create_manager' (ce6395ce-82cb-4889-b38a-06a669e26f3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:32:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-08e17bb4-adf0-4fa5-b509-ee0186d21906 tempest-ServerActionsTestOtherA-1610590813 None] Lock "cinder-e363f1a1-7198-4c78-bc8a-e8a8feb1815d-delete_volume" released by "delete_volume" :: held 2.984s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:32:11 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-06b3e142-59eb-47eb-a60d-765f5193b1ea tempest-TestInstancesWithCinderVolumes-693752400 None] Created volume successfully. Nov 06 14:32:13 devstack sudo[94859]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_3tzrj58wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9d4a4b38-2c5a-4c45-873d-d5faee2e8598" returned: 0 in 3.242s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:13 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_3tzrj58wdevstack@QuobyteHD, size 112.00 MB, duration 3.24 sec, destination /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9d4a4b38-2c5a-4c45-873d-d5faee2e8598 {{(pid=86854) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 14:32:13 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Converted 112.00 MB image at 34.54 MB/s Nov 06 14:32:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9d4a4b38-2c5a-4c45-873d-d5faee2e8598 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:13 devstack sudo[94903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9d4a4b38-2c5a-4c45-873d-d5faee2e8598 1G Nov 06 14:32:13 devstack sudo[94903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:14 devstack sudo[94903]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9d4a4b38-2c5a-4c45-873d-d5faee2e8598 1G" returned: 0 in 0.513s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:14 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Downloaded image 918d0e99-e622-4342-8eb8-14122332c9ca ((None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}])) to volume 9d4a4b38-2c5a-4c45-873d-d5faee2e8598 successfully. {{(pid=86854) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 14:32:14 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Temporary image 918d0e99-e622-4342-8eb8-14122332c9ca for user a16623f4615c49c79407ce9eb7add66e is deleted. {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 14:32:14 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Marking volume 9d4a4b38-2c5a-4c45-873d-d5faee2e8598 as bootable. {{(pid=86854) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 14:32:14 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Copying metadata from image 918d0e99-e622-4342-8eb8-14122332c9ca to 9d4a4b38-2c5a-4c45-873d-d5faee2e8598. {{(pid=86854) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 14:32:14 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Creating volume glance metadata for volume 9d4a4b38-2c5a-4c45-873d-d5faee2e8598 backed by image 918d0e99-e622-4342-8eb8-14122332c9ca with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86854) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 14:32:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6de5929-4f1b-4d66-b8d0-5a28d88130a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d4a4b38-2c5a-4c45-873d-d5faee2e8598', 'volume_size': 1, 'image_id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15767f46df214a0b8fce21735120de72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'created_at': datetime.datetime(2026, 11, 6, 13, 20, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 20, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0e99-e622-4342-8eb8-14122332c9ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:32:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11746461-610f-4019-b3fb-f6cdaf2e81c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:32:14 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Volume volume-9d4a4b38-2c5a-4c45-873d-d5faee2e8598 (9d4a4b38-2c5a-4c45-873d-d5faee2e8598): created successfully Nov 06 14:32:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11746461-610f-4019-b3fb-f6cdaf2e81c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:32:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Flow 'volume_create_manager' (68583a75-7cd9-4cd5-bafd-c96bf562ef85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:32:14 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-f5e57a5b-fb3e-49ce-80a6-acd08378a161 tempest-VolumesGetTest-1244886629 None] Created volume successfully. Nov 06 14:32:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-26760893-1a61-41f7-93b4-e3dad4bd321c req-fc087073-7e9b-40c5-8563-2e79e68b9e63 tempest-TestInstancesWithCinderVolumes-693752400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:32:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-26760893-1a61-41f7-93b4-e3dad4bd321c req-fc087073-7e9b-40c5-8563-2e79e68b9e63 tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:32:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-26760893-1a61-41f7-93b4-e3dad4bd321c req-fc087073-7e9b-40c5-8563-2e79e68b9e63 tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:32:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-26760893-1a61-41f7-93b4-e3dad4bd321c req-fc087073-7e9b-40c5-8563-2e79e68b9e63 tempest-TestInstancesWithCinderVolumes-693752400 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e', 'name': 'volume-788ac09b-0d57-48eb-a0b6-96c5e7fe286f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f813ba4-619a-4962-89f3-082fae107de7', 'enforce_multipath': True} {{(pid=86854) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 14:32:16 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:32:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Flow 'volume_create_manager' (33127a07-fd17-414b-bdbb-c3d4a0f55d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:32:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e24aed8-ec82-4f06-b2f8-180954bac601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:32:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e24aed8-ec82-4f06-b2f8-180954bac601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:32:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-857408352',display_name='tempest-VolumesGetTest-Volume-243312932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2c91d3-24f0-4766-81e2-29d03bc6adac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ddb34a0bd44464c9f3c8c1e91372fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:32:16Z,use_quota=True,user_id='a16623f4615c49c79407ce9eb7add66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:32:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388d4445-f42e-4528-b5ce-7ae4e76e1b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:32:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388d4445-f42e-4528-b5ce-7ae4e76e1b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:32:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6854c21b-7cb4-4daf-8860-7536d8c17975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:32:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6854c21b-7cb4-4daf-8860-7536d8c17975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d2c91d3-24f0-4766-81e2-29d03bc6adac', 'volume_name': 'volume-2d2c91d3-24f0-4766-81e2-29d03bc6adac', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:32:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a37f43e-c444-4475-bacd-9c2b5274d354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:32:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a37f43e-c444-4475-bacd-9c2b5274d354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:32:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35f671f8-d5b0-4d4c-8c80-dfec0a4dafc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:32:16 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Volume 2d2c91d3-24f0-4766-81e2-29d03bc6adac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d2c91d3-24f0-4766-81e2-29d03bc6adac', 'volume_size': 1} Nov 06 14:32:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:32:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:32:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:32:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-857408352',display_name='tempest-VolumesGetTest-Volume-243312932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2c91d3-24f0-4766-81e2-29d03bc6adac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ddb34a0bd44464c9f3c8c1e91372fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:32:16Z,use_quota=True,user_id='a16623f4615c49c79407ce9eb7add66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:32:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Creating volume 2d2c91d3-24f0-4766-81e2-29d03bc6adac {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:32:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:32:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:32:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:32:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:32:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:32:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:32:16 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:32:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d2c91d3-24f0-4766-81e2-29d03bc6adac 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:16 devstack sudo[94917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d2c91d3-24f0-4766-81e2-29d03bc6adac 1073741824 Nov 06 14:32:16 devstack sudo[94917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:16 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-26760893-1a61-41f7-93b4-e3dad4bd321c req-fc087073-7e9b-40c5-8563-2e79e68b9e63 tempest-TestInstancesWithCinderVolumes-693752400 None] attachment_update completed successfully. Nov 06 14:32:16 devstack sudo[94917]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d2c91d3-24f0-4766-81e2-29d03bc6adac 1073741824" returned: 0 in 0.700s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d2c91d3-24f0-4766-81e2-29d03bc6adac {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:17 devstack sudo[94923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d2c91d3-24f0-4766-81e2-29d03bc6adac Nov 06 14:32:17 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:17 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d2c91d3-24f0-4766-81e2-29d03bc6adac" returned: 0 in 0.322s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:32:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:32:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35f671f8-d5b0-4d4c-8c80-dfec0a4dafc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d2c91d3-24f0-4766-81e2-29d03bc6adac', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:32:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed55259-188c-401b-994d-29d2f362ee89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:32:17 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Volume volume-2d2c91d3-24f0-4766-81e2-29d03bc6adac (2d2c91d3-24f0-4766-81e2-29d03bc6adac): created successfully Nov 06 14:32:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed55259-188c-401b-994d-29d2f362ee89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:32:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Flow 'volume_create_manager' (33127a07-fd17-414b-bdbb-c3d4a0f55d6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:32:17 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-13750752-c203-4a74-9157-ef4fa2c5079d tempest-VolumesGetTest-1244886629 None] Created volume successfully. Nov 06 14:32:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2e76fa4e-d5e5-4ff5-9a1d-680d38657e49 tempest-VolumesGetTest-1244886629 None] Acquiring lock "cinder-2d2c91d3-24f0-4766-81e2-29d03bc6adac-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:32:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2e76fa4e-d5e5-4ff5-9a1d-680d38657e49 tempest-VolumesGetTest-1244886629 None] Lock "cinder-2d2c91d3-24f0-4766-81e2-29d03bc6adac-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:32:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2e76fa4e-d5e5-4ff5-9a1d-680d38657e49 tempest-VolumesGetTest-1244886629 None] Acquiring lock "cinder-quobyte-2d2c91d3-24f0-4766-81e2-29d03bc6adac" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:32:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2e76fa4e-d5e5-4ff5-9a1d-680d38657e49 tempest-VolumesGetTest-1244886629 None] Lock "cinder-quobyte-2d2c91d3-24f0-4766-81e2-29d03bc6adac" acquired by "delete_volume" :: waited 0.030s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:32:18 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45a5d56-e02a-4e42-99bb-e1bb8317f547]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:32:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2e76fa4e-d5e5-4ff5-9a1d-680d38657e49 tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d2c91d3-24f0-4766-81e2-29d03bc6adac {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:18 devstack sudo[94928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d2c91d3-24f0-4766-81e2-29d03bc6adac Nov 06 14:32:18 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:19 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2e76fa4e-d5e5-4ff5-9a1d-680d38657e49 tempest-VolumesGetTest-1244886629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d2c91d3-24f0-4766-81e2-29d03bc6adac" returned: 0 in 0.506s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2e76fa4e-d5e5-4ff5-9a1d-680d38657e49 tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d2c91d3-24f0-4766-81e2-29d03bc6adac {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:19 devstack sudo[94933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d2c91d3-24f0-4766-81e2-29d03bc6adac Nov 06 14:32:19 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:19 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2e76fa4e-d5e5-4ff5-9a1d-680d38657e49 tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d2c91d3-24f0-4766-81e2-29d03bc6adac" returned: 0 in 0.655s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2e76fa4e-d5e5-4ff5-9a1d-680d38657e49 tempest-VolumesGetTest-1244886629 None] Lock "cinder-quobyte-2d2c91d3-24f0-4766-81e2-29d03bc6adac" released by "delete_volume" :: held 1.255s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:32:19 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-2e76fa4e-d5e5-4ff5-9a1d-680d38657e49 tempest-VolumesGetTest-1244886629 None] Created reservations ['375e4432-6e5c-43f8-8cdf-aee9841b5919', 'deae87e6-d3d5-46f1-b804-6f2423f99579', '533799fe-814b-4148-a5f8-c24e2cb2bf36', '60d7d74a-4581-4db4-bbea-03c923b5cd0e'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:32:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2e76fa4e-d5e5-4ff5-9a1d-680d38657e49 tempest-VolumesGetTest-1244886629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:32:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2e76fa4e-d5e5-4ff5-9a1d-680d38657e49 tempest-VolumesGetTest-1244886629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:32:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2e76fa4e-d5e5-4ff5-9a1d-680d38657e49 tempest-VolumesGetTest-1244886629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:32:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2e76fa4e-d5e5-4ff5-9a1d-680d38657e49 tempest-VolumesGetTest-1244886629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:32:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2e76fa4e-d5e5-4ff5-9a1d-680d38657e49 tempest-VolumesGetTest-1244886629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:32:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2e76fa4e-d5e5-4ff5-9a1d-680d38657e49 tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:20 devstack sudo[94979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:32:20 devstack sudo[94979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:20 devstack sudo[94979]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2e76fa4e-d5e5-4ff5-9a1d-680d38657e49 tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.543s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:20 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-2e76fa4e-d5e5-4ff5-9a1d-680d38657e49 tempest-VolumesGetTest-1244886629 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:32:20 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-2e76fa4e-d5e5-4ff5-9a1d-680d38657e49 tempest-VolumesGetTest-1244886629 None] Deleted volume successfully. Nov 06 14:32:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2e76fa4e-d5e5-4ff5-9a1d-680d38657e49 tempest-VolumesGetTest-1244886629 None] Lock "cinder-2d2c91d3-24f0-4766-81e2-29d03bc6adac-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:32:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3bc8e88f-4b3d-47e2-b24a-5d1215b207c2 tempest-VolumesGetTest-1244886629 None] Acquiring lock "cinder-9d4a4b38-2c5a-4c45-873d-d5faee2e8598-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:32:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3bc8e88f-4b3d-47e2-b24a-5d1215b207c2 tempest-VolumesGetTest-1244886629 None] Lock "cinder-9d4a4b38-2c5a-4c45-873d-d5faee2e8598-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:32:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3bc8e88f-4b3d-47e2-b24a-5d1215b207c2 tempest-VolumesGetTest-1244886629 None] Acquiring lock "cinder-quobyte-9d4a4b38-2c5a-4c45-873d-d5faee2e8598" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:32:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3bc8e88f-4b3d-47e2-b24a-5d1215b207c2 tempest-VolumesGetTest-1244886629 None] Lock "cinder-quobyte-9d4a4b38-2c5a-4c45-873d-d5faee2e8598" acquired by "delete_volume" :: waited 0.060s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:32:21 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[03636efa-9d9a-4e39-85f9-585d73e1613a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:32:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3bc8e88f-4b3d-47e2-b24a-5d1215b207c2 tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9d4a4b38-2c5a-4c45-873d-d5faee2e8598 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:21 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9d4a4b38-2c5a-4c45-873d-d5faee2e8598 Nov 06 14:32:21 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:22 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3bc8e88f-4b3d-47e2-b24a-5d1215b207c2 tempest-VolumesGetTest-1244886629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9d4a4b38-2c5a-4c45-873d-d5faee2e8598" returned: 0 in 0.810s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3bc8e88f-4b3d-47e2-b24a-5d1215b207c2 tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9d4a4b38-2c5a-4c45-873d-d5faee2e8598 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:22 devstack sudo[95014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9d4a4b38-2c5a-4c45-873d-d5faee2e8598 Nov 06 14:32:22 devstack sudo[95014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:22 devstack sudo[95014]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3bc8e88f-4b3d-47e2-b24a-5d1215b207c2 tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9d4a4b38-2c5a-4c45-873d-d5faee2e8598" returned: 0 in 0.491s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3bc8e88f-4b3d-47e2-b24a-5d1215b207c2 tempest-VolumesGetTest-1244886629 None] Lock "cinder-quobyte-9d4a4b38-2c5a-4c45-873d-d5faee2e8598" released by "delete_volume" :: held 1.416s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:32:22 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-3bc8e88f-4b3d-47e2-b24a-5d1215b207c2 tempest-VolumesGetTest-1244886629 None] Created reservations ['fac36a5d-a919-4cd5-8427-8e196b30e27c', '21d100b2-b809-4f73-acb2-5a153b83e632', '90da7bc9-4328-468f-8378-6cd2f172b79a', 'a1fb22eb-47d9-4a6f-96ec-5424bc45d82a'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:32:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:32:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:32:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:32:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:32:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:32:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:32:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:23 devstack sudo[95025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:32:23 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3bc8e88f-4b3d-47e2-b24a-5d1215b207c2 tempest-VolumesGetTest-1244886629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:32:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3bc8e88f-4b3d-47e2-b24a-5d1215b207c2 tempest-VolumesGetTest-1244886629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:32:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3bc8e88f-4b3d-47e2-b24a-5d1215b207c2 tempest-VolumesGetTest-1244886629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:32:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3bc8e88f-4b3d-47e2-b24a-5d1215b207c2 tempest-VolumesGetTest-1244886629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:32:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3bc8e88f-4b3d-47e2-b24a-5d1215b207c2 tempest-VolumesGetTest-1244886629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:32:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3bc8e88f-4b3d-47e2-b24a-5d1215b207c2 tempest-VolumesGetTest-1244886629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:23 devstack sudo[95027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:32:23 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:23 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.763s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:23 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:32:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager._thread_info {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:32:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread count: 28 {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 14:32:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread info: [<_MainThread(MainThread, started 130306900594816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 14:32:24 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3bc8e88f-4b3d-47e2-b24a-5d1215b207c2 tempest-VolumesGetTest-1244886629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.691s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:24 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-3bc8e88f-4b3d-47e2-b24a-5d1215b207c2 tempest-VolumesGetTest-1244886629 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:32:24 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-3bc8e88f-4b3d-47e2-b24a-5d1215b207c2 tempest-VolumesGetTest-1244886629 None] Deleted volume successfully. Nov 06 14:32:24 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3bc8e88f-4b3d-47e2-b24a-5d1215b207c2 tempest-VolumesGetTest-1244886629 None] Lock "cinder-9d4a4b38-2c5a-4c45-873d-d5faee2e8598-delete_volume" released by "delete_volume" :: held 2.837s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:32:33 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:UPDATE=90,cinder:SELECT=80,cinder:INSERT=31,cinder:DELETE=7 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:32:34 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:UPDATE=83,cinder:DELETE=8,cinder:SELECT=74,cinder:INSERT=27 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:32:35 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-69148a48-365c-4439-9902-758deb838791 req-f5bea112-cf1b-4fde-9753-632ab91cb357 tempest-AttachVolumeTestJSON-100281132 None] Terminate volume connection completed successfully. Nov 06 14:32:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-69148a48-365c-4439-9902-758deb838791 req-f5bea112-cf1b-4fde-9753-632ab91cb357 tempest-AttachVolumeTestJSON-100281132 None] Deleting attachment de04132e-7ac4-42cb-89e2-f7261f78665c. {{(pid=86854) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 14:32:45 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=1 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:32:45 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=1 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:32:52 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:32:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Flow 'volume_create_manager' (c240e7d5-09c1-42c2-9c40-1e78035869a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:32:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8055ab4a-507e-43e0-8e1a-ddb5010fb5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:32:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8055ab4a-507e-43e0-8e1a-ddb5010fb5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-523330999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56925201-13ef-42ed-ad6a-f27e2934883b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8697f74971c4cbead991fd9584b63fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:32:53Z,use_quota=True,user_id='82c7dbba21c94d2586d9ea0de9415d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:32:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b539b630-98e3-4e39-b674-76930550632f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:32:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b539b630-98e3-4e39-b674-76930550632f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:32:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b2c157-9a5e-44fb-b2f0-51b79c54c3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:32:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b2c157-9a5e-44fb-b2f0-51b79c54c3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56925201-13ef-42ed-ad6a-f27e2934883b', 'volume_name': 'volume-56925201-13ef-42ed-ad6a-f27e2934883b', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:32:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b010778d-32a0-42f2-bdb0-2f6adfe3fa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:32:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b010778d-32a0-42f2-bdb0-2f6adfe3fa01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:32:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5961fac-d8c0-4594-b028-25da22bb217c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:32:53 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Volume 56925201-13ef-42ed-ad6a-f27e2934883b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56925201-13ef-42ed-ad6a-f27e2934883b', 'volume_size': 1} Nov 06 14:32:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:32:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:32:53 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-523330999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56925201-13ef-42ed-ad6a-f27e2934883b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8697f74971c4cbead991fd9584b63fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:32:53Z,use_quota=True,user_id='82c7dbba21c94d2586d9ea0de9415d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:32:53 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Creating volume 56925201-13ef-42ed-ad6a-f27e2934883b {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:32:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:32:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:32:53 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:32:53 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:32:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:32:53 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:32:53 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:32:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:53 devstack sudo[95237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b 1073741824 Nov 06 14:32:53 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:54 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b 1073741824" returned: 0 in 1.331s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:54 devstack sudo[95285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b Nov 06 14:32:54 devstack sudo[95285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:54 devstack sudo[95285]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b" returned: 0 in 0.402s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] <== create_volume: return (1845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:32:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:32:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5961fac-d8c0-4594-b028-25da22bb217c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56925201-13ef-42ed-ad6a-f27e2934883b', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:32:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2175047-6581-430a-9bab-1857d9fc7bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:32:55 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Volume volume-56925201-13ef-42ed-ad6a-f27e2934883b (56925201-13ef-42ed-ad6a-f27e2934883b): created successfully Nov 06 14:32:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2175047-6581-430a-9bab-1857d9fc7bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:32:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Flow 'volume_create_manager' (c240e7d5-09c1-42c2-9c40-1e78035869a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:32:55 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-b1ecf716-27d6-4c5e-ad17-a4b11bff35a9 tempest-VolumesSnapshotTestJSON-254760034 None] Created volume successfully. Nov 06 14:32:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-21441689-5db6-42fd-b04f-77b32f1dd924 tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:32:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-21441689-5db6-42fd-b04f-77b32f1dd924 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:32:56 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-21441689-5db6-42fd-b04f-77b32f1dd924 tempest-VolumesSnapshotTestJSON-254760034 None] Creating offline snapshot ffa8ca6f-1016-4e03-8744-04b497765d17 of volume 56925201-13ef-42ed-ad6a-f27e2934883b {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:32:56 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ced6346-3f59-43ad-8b20-5e266271403f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:32:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-21441689-5db6-42fd-b04f-77b32f1dd924 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:56 devstack sudo[95300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b Nov 06 14:32:56 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-869ce60c-f59f-4721-8b30-39a561b2e73b req-42dde0a2-49b6-4d9a-b6cd-64e627a93def tempest-TestInstancesWithCinderVolumes-693752400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:32:56 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-21441689-5db6-42fd-b04f-77b32f1dd924 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b" returned: 0 in 0.709s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-21441689-5db6-42fd-b04f-77b32f1dd924 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b.ffa8ca6f-1016-4e03-8744-04b497765d17 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:56 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b.ffa8ca6f-1016-4e03-8744-04b497765d17 1G Nov 06 14:32:56 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:57 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-21441689-5db6-42fd-b04f-77b32f1dd924 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b.ffa8ca6f-1016-4e03-8744-04b497765d17 1G" returned: 0 in 0.599s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-21441689-5db6-42fd-b04f-77b32f1dd924 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56925201-13ef-42ed-ad6a-f27e2934883b -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b.ffa8ca6f-1016-4e03-8744-04b497765d17 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:57 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56925201-13ef-42ed-ad6a-f27e2934883b -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b.ffa8ca6f-1016-4e03-8744-04b497765d17 Nov 06 14:32:57 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:57 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-21441689-5db6-42fd-b04f-77b32f1dd924 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56925201-13ef-42ed-ad6a-f27e2934883b -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b.ffa8ca6f-1016-4e03-8744-04b497765d17" returned: 0 in 0.516s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:57 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-21441689-5db6-42fd-b04f-77b32f1dd924 tempest-VolumesSnapshotTestJSON-254760034 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b.ffa8ca6f-1016-4e03-8744-04b497765d17 is being set with open permissions: ugo+rw Nov 06 14:32:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-21441689-5db6-42fd-b04f-77b32f1dd924 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b.ffa8ca6f-1016-4e03-8744-04b497765d17 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:57 devstack sudo[95327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b.ffa8ca6f-1016-4e03-8744-04b497765d17 Nov 06 14:32:57 devstack sudo[95327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:58 devstack sudo[95327]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-21441689-5db6-42fd-b04f-77b32f1dd924 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b.ffa8ca6f-1016-4e03-8744-04b497765d17" returned: 0 in 0.321s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-21441689-5db6-42fd-b04f-77b32f1dd924 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:58 devstack sudo[95331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b.info Nov 06 14:32:58 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:58 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-21441689-5db6-42fd-b04f-77b32f1dd924 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b.info" returned: 0 in 0.348s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:58 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-21441689-5db6-42fd-b04f-77b32f1dd924 tempest-VolumesSnapshotTestJSON-254760034 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b.info is being set with open permissions: ugo+rw Nov 06 14:32:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-21441689-5db6-42fd-b04f-77b32f1dd924 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:58 devstack sudo[95334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b.info Nov 06 14:32:58 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:32:58 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root Nov 06 14:32:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-21441689-5db6-42fd-b04f-77b32f1dd924 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b.info" returned: 0 in 0.299s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:32:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-21441689-5db6-42fd-b04f-77b32f1dd924 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.979s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:32:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-869ce60c-f59f-4721-8b30-39a561b2e73b req-42dde0a2-49b6-4d9a-b6cd-64e627a93def tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.225s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:32:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-869ce60c-f59f-4721-8b30-39a561b2e73b req-42dde0a2-49b6-4d9a-b6cd-64e627a93def tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:32:59 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-21441689-5db6-42fd-b04f-77b32f1dd924 tempest-VolumesSnapshotTestJSON-254760034 None] Create snapshot completed successfully Nov 06 14:32:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-869ce60c-f59f-4721-8b30-39a561b2e73b req-42dde0a2-49b6-4d9a-b6cd-64e627a93def tempest-TestInstancesWithCinderVolumes-693752400 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e', 'name': 'volume-b4f9396b-0b65-40b8-89e2-f97df7daa1e8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '303d4455-24b2-4244-b264-983f6bc294e3', 'enforce_multipath': True} {{(pid=86854) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 14:32:59 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-869ce60c-f59f-4721-8b30-39a561b2e73b req-42dde0a2-49b6-4d9a-b6cd-64e627a93def tempest-TestInstancesWithCinderVolumes-693752400 None] attachment_update completed successfully. Nov 06 14:32:59 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e65921ca-ebe8-4fa7-bc2a-bed775772928 tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "cinder-ffa8ca6f-1016-4e03-8744-04b497765d17-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:32:59 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e65921ca-ebe8-4fa7-bc2a-bed775772928 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-ffa8ca6f-1016-4e03-8744-04b497765d17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:32:59 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e65921ca-ebe8-4fa7-bc2a-bed775772928 tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "cinder-quobyte-56925201-13ef-42ed-ad6a-f27e2934883b" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:32:59 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e65921ca-ebe8-4fa7-bc2a-bed775772928 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-56925201-13ef-42ed-ad6a-f27e2934883b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:32:59 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e65921ca-ebe8-4fa7-bc2a-bed775772928 tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "cinder-quobyte-ffa8ca6f-1016-4e03-8744-04b497765d17" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:32:59 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e65921ca-ebe8-4fa7-bc2a-bed775772928 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-ffa8ca6f-1016-4e03-8744-04b497765d17" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:32:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-e65921ca-ebe8-4fa7-bc2a-bed775772928 tempest-VolumesSnapshotTestJSON-254760034 None] Deleting offline snapshot ffa8ca6f-1016-4e03-8744-04b497765d17 of volume 56925201-13ef-42ed-ad6a-f27e2934883b {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:32:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-e65921ca-ebe8-4fa7-bc2a-bed775772928 tempest-VolumesSnapshotTestJSON-254760034 None] snapshot_file for this snap is: volume-56925201-13ef-42ed-ad6a-f27e2934883b.ffa8ca6f-1016-4e03-8744-04b497765d17 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:32:59 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[146f6494-a1ca-41ac-b6b1-d200840683cb]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:32:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e65921ca-ebe8-4fa7-bc2a-bed775772928 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b.ffa8ca6f-1016-4e03-8744-04b497765d17 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:32:59 devstack sudo[95348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b.ffa8ca6f-1016-4e03-8744-04b497765d17 Nov 06 14:32:59 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:00 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e65921ca-ebe8-4fa7-bc2a-bed775772928 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b.ffa8ca6f-1016-4e03-8744-04b497765d17" returned: 0 in 0.397s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-e65921ca-ebe8-4fa7-bc2a-bed775772928 tempest-VolumesSnapshotTestJSON-254760034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56925201-13ef-42ed-ad6a-f27e2934883b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:33:00 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[8869329f-6e8d-46ff-b224-8ab5dc4a5479]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:33:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e65921ca-ebe8-4fa7-bc2a-bed775772928 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:00 devstack sudo[95353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b Nov 06 14:33:00 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:00 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e65921ca-ebe8-4fa7-bc2a-bed775772928 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b" returned: 0 in 0.395s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e65921ca-ebe8-4fa7-bc2a-bed775772928 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b.ffa8ca6f-1016-4e03-8744-04b497765d17 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:00 devstack sudo[95358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b.ffa8ca6f-1016-4e03-8744-04b497765d17 Nov 06 14:33:00 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:00 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e65921ca-ebe8-4fa7-bc2a-bed775772928 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b.ffa8ca6f-1016-4e03-8744-04b497765d17" returned: 0 in 0.361s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e65921ca-ebe8-4fa7-bc2a-bed775772928 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b.ffa8ca6f-1016-4e03-8744-04b497765d17 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:01 devstack sudo[95369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b.ffa8ca6f-1016-4e03-8744-04b497765d17 Nov 06 14:33:01 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:01 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e65921ca-ebe8-4fa7-bc2a-bed775772928 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b.ffa8ca6f-1016-4e03-8744-04b497765d17" returned: 0 in 0.253s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e65921ca-ebe8-4fa7-bc2a-bed775772928 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-ffa8ca6f-1016-4e03-8744-04b497765d17" released by "_delete_snapshot" :: held 1.580s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:33:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e65921ca-ebe8-4fa7-bc2a-bed775772928 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-56925201-13ef-42ed-ad6a-f27e2934883b" released by "delete_snapshot" :: held 1.606s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:33:01 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-e65921ca-ebe8-4fa7-bc2a-bed775772928 tempest-VolumesSnapshotTestJSON-254760034 None] Created reservations ['71551a6d-aaeb-4029-8836-8a9b0e41cec4', '72382182-f3b7-42e1-94ac-cb0b2c2d12b2', 'b70180b5-59f2-42b8-ad14-ee4955d104e1', '8d7d95ad-caf8-4eba-a73c-b97481e9840e'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:33:01 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-e65921ca-ebe8-4fa7-bc2a-bed775772928 tempest-VolumesSnapshotTestJSON-254760034 None] Delete snapshot completed successfully. Nov 06 14:33:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e65921ca-ebe8-4fa7-bc2a-bed775772928 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-ffa8ca6f-1016-4e03-8744-04b497765d17-delete_snapshot" released by "delete_snapshot" :: held 1.809s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:33:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-a5ad490e-0f22-4f0f-9c6a-0ee4aad41326 req-fcd6536a-6760-4b28-8114-8ce86f5303b6 tempest-TestInstancesWithCinderVolumes-693752400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:33:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-a5ad490e-0f22-4f0f-9c6a-0ee4aad41326 req-fcd6536a-6760-4b28-8114-8ce86f5303b6 tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:33:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-a5ad490e-0f22-4f0f-9c6a-0ee4aad41326 req-fcd6536a-6760-4b28-8114-8ce86f5303b6 tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:33:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-a5ad490e-0f22-4f0f-9c6a-0ee4aad41326 req-fcd6536a-6760-4b28-8114-8ce86f5303b6 tempest-TestInstancesWithCinderVolumes-693752400 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e', 'name': 'volume-81e80d0a-6a1d-41a7-9ff7-01443d08916d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '33a2048a-2905-4972-9eb1-3de02537f25a', 'enforce_multipath': True} {{(pid=86854) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 14:33:01 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-a5ad490e-0f22-4f0f-9c6a-0ee4aad41326 req-fcd6536a-6760-4b28-8114-8ce86f5303b6 tempest-TestInstancesWithCinderVolumes-693752400 None] attachment_update completed successfully. Nov 06 14:33:02 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:33:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Flow 'volume_create_manager' (d37a480d-c971-4ab0-8a27-41fbd06a5b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:33:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01499a4d-fa40-4be1-80f8-3263a9d328e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01499a4d-fa40-4be1-80f8-3263a9d328e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-37924843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40740ea6-ace4-4c50-8313-b797fc94bfe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8697f74971c4cbead991fd9584b63fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:33:02Z,use_quota=True,user_id='82c7dbba21c94d2586d9ea0de9415d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af52ebd3-0cff-4da5-90b5-7e199485f7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af52ebd3-0cff-4da5-90b5-7e199485f7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c7aff10-6fa8-4dea-87e4-818795c75e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c7aff10-6fa8-4dea-87e4-818795c75e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40740ea6-ace4-4c50-8313-b797fc94bfe1', 'volume_name': 'volume-40740ea6-ace4-4c50-8313-b797fc94bfe1', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (795488ff-d4ef-4f03-a1e1-d7b73d93c397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (795488ff-d4ef-4f03-a1e1-d7b73d93c397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a2a0ea6-c93e-48f4-8d25-f628934ebba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:02 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Volume 40740ea6-ace4-4c50-8313-b797fc94bfe1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40740ea6-ace4-4c50-8313-b797fc94bfe1', 'volume_size': 1} Nov 06 14:33:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:33:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:33:02 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-37924843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40740ea6-ace4-4c50-8313-b797fc94bfe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8697f74971c4cbead991fd9584b63fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:33:02Z,use_quota=True,user_id='82c7dbba21c94d2586d9ea0de9415d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:33:02 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Creating volume 40740ea6-ace4-4c50-8313-b797fc94bfe1 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:33:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:33:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:33:02 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:33:02 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:33:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:33:02 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:33:02 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:33:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:02 devstack sudo[95387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1 1073741824 Nov 06 14:33:02 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:03 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1 1073741824" returned: 0 in 0.523s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:03 devstack sudo[95435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1 Nov 06 14:33:03 devstack sudo[95435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:03 devstack sudo[95435]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1" returned: 0 in 0.341s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:03 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:33:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:33:03 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a2a0ea6-c93e-48f4-8d25-f628934ebba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40740ea6-ace4-4c50-8313-b797fc94bfe1', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:03 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383ec794-63e9-421c-9c1b-cb3ebc117d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:03 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Volume volume-40740ea6-ace4-4c50-8313-b797fc94bfe1 (40740ea6-ace4-4c50-8313-b797fc94bfe1): created successfully Nov 06 14:33:03 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383ec794-63e9-421c-9c1b-cb3ebc117d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:03 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Flow 'volume_create_manager' (d37a480d-c971-4ab0-8a27-41fbd06a5b2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:33:03 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-c9fbf9e7-8fa4-45ba-9277-307e12ee23c7 tempest-VolumesSnapshotTestJSON-254760034 None] Created volume successfully. Nov 06 14:33:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b0e7d746-228a-417e-91bb-3a2cd172b94d tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:33:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b0e7d746-228a-417e-91bb-3a2cd172b94d tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:33:04 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-b0e7d746-228a-417e-91bb-3a2cd172b94d tempest-VolumesSnapshotTestJSON-254760034 None] Creating offline snapshot e60b838d-49f4-4ed1-a2f1-303b49969b25 of volume 40740ea6-ace4-4c50-8313-b797fc94bfe1 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:33:04 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c35752-0483-4fb0-9327-e89e1b558f90]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:33:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b0e7d746-228a-417e-91bb-3a2cd172b94d tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:05 devstack sudo[95440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1 Nov 06 14:33:05 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:05 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b0e7d746-228a-417e-91bb-3a2cd172b94d tempest-VolumesSnapshotTestJSON-254760034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1" returned: 0 in 0.391s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b0e7d746-228a-417e-91bb-3a2cd172b94d tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.e60b838d-49f4-4ed1-a2f1-303b49969b25 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:05 devstack sudo[95451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.e60b838d-49f4-4ed1-a2f1-303b49969b25 1G Nov 06 14:33:05 devstack sudo[95451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:05 devstack sudo[95451]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b0e7d746-228a-417e-91bb-3a2cd172b94d tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.e60b838d-49f4-4ed1-a2f1-303b49969b25 1G" returned: 0 in 0.487s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b0e7d746-228a-417e-91bb-3a2cd172b94d tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40740ea6-ace4-4c50-8313-b797fc94bfe1 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.e60b838d-49f4-4ed1-a2f1-303b49969b25 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:05 devstack sudo[95464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40740ea6-ace4-4c50-8313-b797fc94bfe1 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.e60b838d-49f4-4ed1-a2f1-303b49969b25 Nov 06 14:33:05 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:06 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b0e7d746-228a-417e-91bb-3a2cd172b94d tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40740ea6-ace4-4c50-8313-b797fc94bfe1 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.e60b838d-49f4-4ed1-a2f1-303b49969b25" returned: 0 in 0.315s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:06 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-b0e7d746-228a-417e-91bb-3a2cd172b94d tempest-VolumesSnapshotTestJSON-254760034 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.e60b838d-49f4-4ed1-a2f1-303b49969b25 is being set with open permissions: ugo+rw Nov 06 14:33:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b0e7d746-228a-417e-91bb-3a2cd172b94d tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.e60b838d-49f4-4ed1-a2f1-303b49969b25 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:06 devstack sudo[95475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.e60b838d-49f4-4ed1-a2f1-303b49969b25 Nov 06 14:33:06 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:06 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b0e7d746-228a-417e-91bb-3a2cd172b94d tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.e60b838d-49f4-4ed1-a2f1-303b49969b25" returned: 0 in 0.264s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b0e7d746-228a-417e-91bb-3a2cd172b94d tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:06 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.info Nov 06 14:33:06 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:06 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b0e7d746-228a-417e-91bb-3a2cd172b94d tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.info" returned: 0 in 0.382s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:06 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-b0e7d746-228a-417e-91bb-3a2cd172b94d tempest-VolumesSnapshotTestJSON-254760034 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.info is being set with open permissions: ugo+rw Nov 06 14:33:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b0e7d746-228a-417e-91bb-3a2cd172b94d tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:06 devstack sudo[95490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.info Nov 06 14:33:06 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:07 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b0e7d746-228a-417e-91bb-3a2cd172b94d tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.info" returned: 0 in 0.308s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b0e7d746-228a-417e-91bb-3a2cd172b94d tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.296s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:33:07 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-3209e797-0fc8-4b28-b058-663e5bd9eb21 req-e37bd3de-0b8f-4b9d-b914-0712beb08568 tempest-TestInstancesWithCinderVolumes-693752400 None] Terminate volume connection completed successfully. Nov 06 14:33:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-3209e797-0fc8-4b28-b058-663e5bd9eb21 req-e37bd3de-0b8f-4b9d-b914-0712beb08568 tempest-TestInstancesWithCinderVolumes-693752400 None] Deleting attachment 303d4455-24b2-4244-b264-983f6bc294e3. {{(pid=86854) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 14:33:07 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-b0e7d746-228a-417e-91bb-3a2cd172b94d tempest-VolumesSnapshotTestJSON-254760034 None] Create snapshot completed successfully Nov 06 14:33:07 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-446cfebd-d41f-406f-8491-6ba9b0ece1ae tempest-TestInstancesWithCinderVolumes-693752400 None] Acquiring lock "cinder-b4f9396b-0b65-40b8-89e2-f97df7daa1e8-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:33:07 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-446cfebd-d41f-406f-8491-6ba9b0ece1ae tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "cinder-b4f9396b-0b65-40b8-89e2-f97df7daa1e8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:33:07 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-446cfebd-d41f-406f-8491-6ba9b0ece1ae tempest-TestInstancesWithCinderVolumes-693752400 None] Acquiring lock "cinder-quobyte-b4f9396b-0b65-40b8-89e2-f97df7daa1e8" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:33:07 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-446cfebd-d41f-406f-8491-6ba9b0ece1ae tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "cinder-quobyte-b4f9396b-0b65-40b8-89e2-f97df7daa1e8" acquired by "delete_volume" :: waited 0.029s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:33:08 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f64188-f2b3-493c-8b2a-6c71a0664c7f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:33:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-446cfebd-d41f-406f-8491-6ba9b0ece1ae tempest-TestInstancesWithCinderVolumes-693752400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b4f9396b-0b65-40b8-89e2-f97df7daa1e8 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:08 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b4f9396b-0b65-40b8-89e2-f97df7daa1e8 Nov 06 14:33:08 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:08 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-446cfebd-d41f-406f-8491-6ba9b0ece1ae tempest-TestInstancesWithCinderVolumes-693752400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b4f9396b-0b65-40b8-89e2-f97df7daa1e8" returned: 0 in 0.478s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-446cfebd-d41f-406f-8491-6ba9b0ece1ae tempest-TestInstancesWithCinderVolumes-693752400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b4f9396b-0b65-40b8-89e2-f97df7daa1e8 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:08 devstack sudo[95504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b4f9396b-0b65-40b8-89e2-f97df7daa1e8 Nov 06 14:33:08 devstack sudo[95504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:08 devstack sudo[95504]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-446cfebd-d41f-406f-8491-6ba9b0ece1ae tempest-TestInstancesWithCinderVolumes-693752400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b4f9396b-0b65-40b8-89e2-f97df7daa1e8" returned: 0 in 0.365s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:08 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-446cfebd-d41f-406f-8491-6ba9b0ece1ae tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "cinder-quobyte-b4f9396b-0b65-40b8-89e2-f97df7daa1e8" released by "delete_volume" :: held 0.948s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:33:08 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:33:08 devstack cinder-volume[86854]: WARNING cinder.quota [None req-446cfebd-d41f-406f-8491-6ba9b0ece1ae tempest-TestInstancesWithCinderVolumes-693752400 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-378958023-325093678 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-378958023-325093678, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:33:08 devstack cinder-volume[86854]: WARNING cinder.quota [None req-446cfebd-d41f-406f-8491-6ba9b0ece1ae tempest-TestInstancesWithCinderVolumes-693752400 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-378958023-325093678 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-378958023-325093678, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:33:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Flow 'volume_create_manager' (c47fcdba-e501-4ba8-96cc-bb8553f07ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c4904e-aabd-46a3-bdbc-380b637e0e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c4904e-aabd-46a3-bdbc-380b637e0e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1142754667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c4fb727-44a8-4717-87f0-23496668b57f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8697f74971c4cbead991fd9584b63fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:33:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e60b838d-49f4-4ed1-a2f1-303b49969b25,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:33:09Z,use_quota=True,user_id='82c7dbba21c94d2586d9ea0de9415d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c914f3-749b-4e6d-b0ea-851fde7b6e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c914f3-749b-4e6d-b0ea-851fde7b6e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b230f601-cfce-4c09-9a21-2399b298fb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b230f601-cfce-4c09-9a21-2399b298fb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4c4fb727-44a8-4717-87f0-23496668b57f', 'volume_name': 'volume-4c4fb727-44a8-4717-87f0-23496668b57f', 'volume_size': 2, 'snapshot_id': 'e60b838d-49f4-4ed1-a2f1-303b49969b25'}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2475e1c-c790-406c-8e66-304fc6fce4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2475e1c-c790-406c-8e66-304fc6fce4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af3e35d-de2d-4be8-b7b5-c96e46c92222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:09 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Volume 4c4fb727-44a8-4717-87f0-23496668b57f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4c4fb727-44a8-4717-87f0-23496668b57f', 'volume_size': 2, 'snapshot_id': 'e60b838d-49f4-4ed1-a2f1-303b49969b25'} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "cinder-quobyte-e60b838d-49f4-4ed1-a2f1-303b49969b25-4c4fb727-44a8-4717-87f0-23496668b57f" by "_create_volume_from_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-446cfebd-d41f-406f-8491-6ba9b0ece1ae tempest-TestInstancesWithCinderVolumes-693752400 None] Created reservations ['0cb70c6d-71aa-4a48-aad8-6c7d88c0db2e', 'f949761c-6ce5-4939-89fb-0cdd89054fd3', 'bcfd1469-20c0-464d-bd09-0209ff150f39', 'ad4a5294-e4f9-4ad6-aa37-32de93bcd280'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-e60b838d-49f4-4ed1-a2f1-303b49969b25-4c4fb727-44a8-4717-87f0-23496668b57f" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Creating volume 4c4fb727-44a8-4717-87f0-23496668b57f from snapshot e60b838d-49f4-4ed1-a2f1-303b49969b25 {{(pid=86854) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "cinder-quobyte-4c4fb727-44a8-4717-87f0-23496668b57f" by "_copy_volume_from_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-4c4fb727-44a8-4717-87f0-23496668b57f" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] snapshot: e60b838d-49f4-4ed1-a2f1-303b49969b25, volume: 4c4fb727-44a8-4717-87f0-23496668b57f, {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff513d3-128e-45e4-9630-8020809027e3]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.e60b838d-49f4-4ed1-a2f1-303b49969b25 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-446cfebd-d41f-406f-8491-6ba9b0ece1ae tempest-TestInstancesWithCinderVolumes-693752400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-446cfebd-d41f-406f-8491-6ba9b0ece1ae tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-446cfebd-d41f-406f-8491-6ba9b0ece1ae tempest-TestInstancesWithCinderVolumes-693752400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-446cfebd-d41f-406f-8491-6ba9b0ece1ae tempest-TestInstancesWithCinderVolumes-693752400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-446cfebd-d41f-406f-8491-6ba9b0ece1ae tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-446cfebd-d41f-406f-8491-6ba9b0ece1ae tempest-TestInstancesWithCinderVolumes-693752400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:09 devstack sudo[95543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:33:09 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:09 devstack sudo[95541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.e60b838d-49f4-4ed1-a2f1-303b49969b25 Nov 06 14:33:09 devstack sudo[95541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:09 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-446cfebd-d41f-406f-8491-6ba9b0ece1ae tempest-TestInstancesWithCinderVolumes-693752400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.323s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-446cfebd-d41f-406f-8491-6ba9b0ece1ae tempest-TestInstancesWithCinderVolumes-693752400 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:33:09 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-446cfebd-d41f-406f-8491-6ba9b0ece1ae tempest-TestInstancesWithCinderVolumes-693752400 None] Deleted volume successfully. Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-446cfebd-d41f-406f-8491-6ba9b0ece1ae tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "cinder-b4f9396b-0b65-40b8-89e2-f97df7daa1e8-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:33:09 devstack sudo[95541]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.e60b838d-49f4-4ed1-a2f1-303b49969b25" returned: 0 in 0.490s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40740ea6-ace4-4c50-8313-b797fc94bfe1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f53896-8af7-4cf4-baa3-686ea435d4f7]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:33:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:09 devstack sudo[95558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1 Nov 06 14:33:09 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:10 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1" returned: 0 in 0.418s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:10 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1 {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 14:33:10 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Creating direct copy from snapshot {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 14:33:10 devstack cinder-volume[86854]: DEBUG cinder.utils [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Path /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4c4fb727-44a8-4717-87f0-23496668b57f not found in is_blk_device check {{(pid=86854) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 14:33:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4c4fb727-44a8-4717-87f0-23496668b57f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:10 devstack sudo[95569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4c4fb727-44a8-4717-87f0-23496668b57f Nov 06 14:33:10 devstack sudo[95569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:13 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-4d97ffe2-79d2-4bf3-a1ee-63a4562f8c0a req-da9b5368-091b-4efb-bc2f-45f8329c0f58 tempest-TestInstancesWithCinderVolumes-693752400 None] Terminate volume connection completed successfully. Nov 06 14:33:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-4d97ffe2-79d2-4bf3-a1ee-63a4562f8c0a req-da9b5368-091b-4efb-bc2f-45f8329c0f58 tempest-TestInstancesWithCinderVolumes-693752400 None] Deleting attachment 33a2048a-2905-4972-9eb1-3de02537f25a. {{(pid=86854) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 14:33:13 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8f69369e-1c88-488e-8d6e-8c8e7419430b tempest-TestInstancesWithCinderVolumes-693752400 None] Acquiring lock "cinder-81e80d0a-6a1d-41a7-9ff7-01443d08916d-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:33:13 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8f69369e-1c88-488e-8d6e-8c8e7419430b tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "cinder-81e80d0a-6a1d-41a7-9ff7-01443d08916d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:33:13 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8f69369e-1c88-488e-8d6e-8c8e7419430b tempest-TestInstancesWithCinderVolumes-693752400 None] Acquiring lock "cinder-quobyte-81e80d0a-6a1d-41a7-9ff7-01443d08916d" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:33:13 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8f69369e-1c88-488e-8d6e-8c8e7419430b tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "cinder-quobyte-81e80d0a-6a1d-41a7-9ff7-01443d08916d" acquired by "delete_volume" :: waited 0.026s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:33:13 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[944afe19-1db0-4b2a-8a7d-f31bb43629e6]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:33:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8f69369e-1c88-488e-8d6e-8c8e7419430b tempest-TestInstancesWithCinderVolumes-693752400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-81e80d0a-6a1d-41a7-9ff7-01443d08916d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:14 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-81e80d0a-6a1d-41a7-9ff7-01443d08916d Nov 06 14:33:14 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:14 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8f69369e-1c88-488e-8d6e-8c8e7419430b tempest-TestInstancesWithCinderVolumes-693752400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-81e80d0a-6a1d-41a7-9ff7-01443d08916d" returned: 0 in 0.903s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8f69369e-1c88-488e-8d6e-8c8e7419430b tempest-TestInstancesWithCinderVolumes-693752400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-81e80d0a-6a1d-41a7-9ff7-01443d08916d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:14 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-81e80d0a-6a1d-41a7-9ff7-01443d08916d Nov 06 14:33:14 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:15 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8f69369e-1c88-488e-8d6e-8c8e7419430b tempest-TestInstancesWithCinderVolumes-693752400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-81e80d0a-6a1d-41a7-9ff7-01443d08916d" returned: 0 in 0.448s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:15 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8f69369e-1c88-488e-8d6e-8c8e7419430b tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "cinder-quobyte-81e80d0a-6a1d-41a7-9ff7-01443d08916d" released by "delete_volume" :: held 1.500s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:33:15 devstack cinder-volume[86854]: WARNING cinder.quota [None req-8f69369e-1c88-488e-8d6e-8c8e7419430b tempest-TestInstancesWithCinderVolumes-693752400 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-77873328-1335460950 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-77873328-1335460950, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:33:15 devstack cinder-volume[86854]: WARNING cinder.quota [None req-8f69369e-1c88-488e-8d6e-8c8e7419430b tempest-TestInstancesWithCinderVolumes-693752400 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-77873328-1335460950 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-77873328-1335460950, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:33:15 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-8f69369e-1c88-488e-8d6e-8c8e7419430b tempest-TestInstancesWithCinderVolumes-693752400 None] Created reservations ['1c17ed4b-a140-4c89-8812-915d249ffd80', 'a1d08ef3-625a-48af-bcba-e355f8da5da7', 'c04cdd4c-58a8-4ef3-aad8-0724976382fb', '5cf9a7bf-076a-4a0a-8b6f-13a4dd71d0ad'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:33:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8f69369e-1c88-488e-8d6e-8c8e7419430b tempest-TestInstancesWithCinderVolumes-693752400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:33:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8f69369e-1c88-488e-8d6e-8c8e7419430b tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:33:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8f69369e-1c88-488e-8d6e-8c8e7419430b tempest-TestInstancesWithCinderVolumes-693752400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:33:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8f69369e-1c88-488e-8d6e-8c8e7419430b tempest-TestInstancesWithCinderVolumes-693752400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:33:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8f69369e-1c88-488e-8d6e-8c8e7419430b tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:33:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8f69369e-1c88-488e-8d6e-8c8e7419430b tempest-TestInstancesWithCinderVolumes-693752400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:15 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:33:15 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:16 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8f69369e-1c88-488e-8d6e-8c8e7419430b tempest-TestInstancesWithCinderVolumes-693752400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.432s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:16 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-8f69369e-1c88-488e-8d6e-8c8e7419430b tempest-TestInstancesWithCinderVolumes-693752400 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:33:16 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-8f69369e-1c88-488e-8d6e-8c8e7419430b tempest-TestInstancesWithCinderVolumes-693752400 None] Deleted volume successfully. Nov 06 14:33:16 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8f69369e-1c88-488e-8d6e-8c8e7419430b tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "cinder-81e80d0a-6a1d-41a7-9ff7-01443d08916d-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:33:19 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:33:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Flow 'volume_create_manager' (beec486b-c673-45e3-b87f-8974beaeb4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:33:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbec4f4f-35a8-4930-adb2-d89d8fbde4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbec4f4f-35a8-4930-adb2-d89d8fbde4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-708891368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9af60c62844347dfbe5727070c2111cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:33:19Z,use_quota=True,user_id='2ef393ee75d1408caceda02b6b9e8f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b6caab6-dda7-4ebe-b30c-3e162155a2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b6caab6-dda7-4ebe-b30c-3e162155a2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1d6341-2c26-4f74-b7af-67ead329da61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1d6341-2c26-4f74-b7af-67ead329da61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4', 'volume_name': 'volume-c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f815899d-2f4d-4922-a1eb-24db8abed820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f815899d-2f4d-4922-a1eb-24db8abed820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec9de84c-ba3f-40c6-b70c-59d5ef1a47ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:19 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Volume c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4', 'volume_size': 1} Nov 06 14:33:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:33:20 devstack sudo[95569]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4c4fb727-44a8-4717-87f0-23496668b57f" returned: 0 in 10.382s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:20 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Image conversion details: src /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1, size 1024.00 MB, duration 10.38 sec, destination /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4c4fb727-44a8-4717-87f0-23496668b57f {{(pid=86854) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 14:33:20 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Converted 1024.00 MB image at 98.62 MB/s Nov 06 14:33:20 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4c4fb727-44a8-4717-87f0-23496668b57f is being set with open permissions: ugo+rw Nov 06 14:33:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4c4fb727-44a8-4717-87f0-23496668b57f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:20 devstack sudo[95667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4c4fb727-44a8-4717-87f0-23496668b57f Nov 06 14:33:20 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:20 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4c4fb727-44a8-4717-87f0-23496668b57f" returned: 0 in 0.365s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-4c4fb727-44a8-4717-87f0-23496668b57f" released by "_copy_volume_from_snapshot" :: held 11.790s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-e60b838d-49f4-4ed1-a2f1-303b49969b25-4c4fb727-44a8-4717-87f0-23496668b57f" released by "_create_volume_from_snapshot" :: held 11.905s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.936s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.740s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-708891368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9af60c62844347dfbe5727070c2111cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:33:19Z,use_quota=True,user_id='2ef393ee75d1408caceda02b6b9e8f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Creating volume c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:33:21 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:21 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4 1073741824 Nov 06 14:33:21 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af3e35d-de2d-4be8-b7b5-c96e46c92222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c4fb727-44a8-4717-87f0-23496668b57f', 'volume_size': 2, 'snapshot_id': 'e60b838d-49f4-4ed1-a2f1-303b49969b25'}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea0731e-364d-4173-980c-5b816a17c294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:21 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Volume volume-4c4fb727-44a8-4717-87f0-23496668b57f (4c4fb727-44a8-4717-87f0-23496668b57f): created successfully Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea0731e-364d-4173-980c-5b816a17c294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Flow 'volume_create_manager' (c47fcdba-e501-4ba8-96cc-bb8553f07ccc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:33:21 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-02e3fda6-2b55-4c68-ac45-98683fe30263 tempest-VolumesSnapshotTestJSON-254760034 None] Created volume successfully. Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e327bfbd-04e2-4ddc-8af0-b139b2a4fede tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "cinder-4c4fb727-44a8-4717-87f0-23496668b57f-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:33:21 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4 1073741824" returned: 0 in 0.529s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e327bfbd-04e2-4ddc-8af0-b139b2a4fede tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-4c4fb727-44a8-4717-87f0-23496668b57f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e327bfbd-04e2-4ddc-8af0-b139b2a4fede tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "cinder-quobyte-4c4fb727-44a8-4717-87f0-23496668b57f" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:33:21 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4 Nov 06 14:33:21 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e327bfbd-04e2-4ddc-8af0-b139b2a4fede tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-4c4fb727-44a8-4717-87f0-23496668b57f" acquired by "delete_volume" :: waited 0.027s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e372e4d-0c3d-4dd5-a9a7-cb2c25793b29]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e327bfbd-04e2-4ddc-8af0-b139b2a4fede tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4c4fb727-44a8-4717-87f0-23496668b57f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:21 devstack sudo[95686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4c4fb727-44a8-4717-87f0-23496668b57f Nov 06 14:33:21 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:21 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4" returned: 0 in 0.300s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec9de84c-ba3f-40c6-b70c-59d5ef1a47ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d0437a7-bc53-4bc3-9a50-43aaecd25386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:21 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Volume volume-c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4 (c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4): created successfully Nov 06 14:33:22 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d0437a7-bc53-4bc3-9a50-43aaecd25386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:22 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Flow 'volume_create_manager' (beec486b-c673-45e3-b87f-8974beaeb4d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:33:22 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-dc50f595-dc6a-4040-a376-47f9781de2ef tempest-AttachVolumeNegativeTest-1303646863 None] Created volume successfully. Nov 06 14:33:22 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e327bfbd-04e2-4ddc-8af0-b139b2a4fede tempest-VolumesSnapshotTestJSON-254760034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4c4fb727-44a8-4717-87f0-23496668b57f" returned: 0 in 0.454s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e327bfbd-04e2-4ddc-8af0-b139b2a4fede tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4c4fb727-44a8-4717-87f0-23496668b57f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:22 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4c4fb727-44a8-4717-87f0-23496668b57f Nov 06 14:33:22 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:22 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-b613ac0e-dc47-40e8-a76c-534f63da918c req-6aeaf7a8-6c12-4a25-9b39-44af318259a4 tempest-TestInstancesWithCinderVolumes-693752400 None] Terminate volume connection completed successfully. Nov 06 14:33:22 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-b613ac0e-dc47-40e8-a76c-534f63da918c req-6aeaf7a8-6c12-4a25-9b39-44af318259a4 tempest-TestInstancesWithCinderVolumes-693752400 None] Deleting attachment 1f813ba4-619a-4962-89f3-082fae107de7. {{(pid=86854) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 14:33:22 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e327bfbd-04e2-4ddc-8af0-b139b2a4fede tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4c4fb727-44a8-4717-87f0-23496668b57f" returned: 0 in 0.445s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e327bfbd-04e2-4ddc-8af0-b139b2a4fede tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-4c4fb727-44a8-4717-87f0-23496668b57f" released by "delete_volume" :: held 0.969s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:33:22 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-e327bfbd-04e2-4ddc-8af0-b139b2a4fede tempest-VolumesSnapshotTestJSON-254760034 None] Created reservations ['8bdd4551-ddf2-4231-a55f-44aa7c0330ca', '434f00a2-889e-4747-b472-db0bb339f93c', '8653811f-3d67-42f6-8eec-aa154ba02e67', 'af5bc849-4fb3-435e-9ff4-70a76000d07b'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:33:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e327bfbd-04e2-4ddc-8af0-b139b2a4fede tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:33:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e327bfbd-04e2-4ddc-8af0-b139b2a4fede tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:33:22 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e327bfbd-04e2-4ddc-8af0-b139b2a4fede tempest-VolumesSnapshotTestJSON-254760034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:33:22 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e327bfbd-04e2-4ddc-8af0-b139b2a4fede tempest-VolumesSnapshotTestJSON-254760034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:33:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e327bfbd-04e2-4ddc-8af0-b139b2a4fede tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:33:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e327bfbd-04e2-4ddc-8af0-b139b2a4fede tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:22 devstack sudo[95702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:33:22 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:33:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:33:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:33:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:33:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:33:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:33:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:23 devstack sudo[95704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:33:23 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:23 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e327bfbd-04e2-4ddc-8af0-b139b2a4fede tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.482s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:23 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-e327bfbd-04e2-4ddc-8af0-b139b2a4fede tempest-VolumesSnapshotTestJSON-254760034 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:33:23 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-e327bfbd-04e2-4ddc-8af0-b139b2a4fede tempest-VolumesSnapshotTestJSON-254760034 None] Deleted volume successfully. Nov 06 14:33:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e327bfbd-04e2-4ddc-8af0-b139b2a4fede tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-4c4fb727-44a8-4717-87f0-23496668b57f-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:33:23 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.354s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:23 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:33:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager._thread_info {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:33:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread count: 28 {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 14:33:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread info: [<_MainThread(MainThread, started 130306900594816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 14:33:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-13e98c6e-6c6a-4d39-a8c7-6082e5a2e9af tempest-TestInstancesWithCinderVolumes-693752400 None] Acquiring lock "cinder-788ac09b-0d57-48eb-a0b6-96c5e7fe286f-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:33:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-13e98c6e-6c6a-4d39-a8c7-6082e5a2e9af tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "cinder-788ac09b-0d57-48eb-a0b6-96c5e7fe286f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:33:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-13e98c6e-6c6a-4d39-a8c7-6082e5a2e9af tempest-TestInstancesWithCinderVolumes-693752400 None] Acquiring lock "cinder-quobyte-788ac09b-0d57-48eb-a0b6-96c5e7fe286f" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:33:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-11f3fb63-ed6c-4fe6-95ab-5453cd8429b8 req-fb71d13d-77b1-4df0-ace1-13d55e9f5524 tempest-AttachVolumeNegativeTest-1303646863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:33:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-11f3fb63-ed6c-4fe6-95ab-5453cd8429b8 req-fb71d13d-77b1-4df0-ace1-13d55e9f5524 tempest-AttachVolumeNegativeTest-1303646863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:33:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-11f3fb63-ed6c-4fe6-95ab-5453cd8429b8 req-fb71d13d-77b1-4df0-ace1-13d55e9f5524 tempest-AttachVolumeNegativeTest-1303646863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:33:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-13e98c6e-6c6a-4d39-a8c7-6082e5a2e9af tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "cinder-quobyte-788ac09b-0d57-48eb-a0b6-96c5e7fe286f" acquired by "delete_volume" :: waited 0.028s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:33:23 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c24012-51fb-4e54-9852-1ccd2c557cb9]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:33:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-13e98c6e-6c6a-4d39-a8c7-6082e5a2e9af tempest-TestInstancesWithCinderVolumes-693752400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-788ac09b-0d57-48eb-a0b6-96c5e7fe286f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-11f3fb63-ed6c-4fe6-95ab-5453cd8429b8 req-fb71d13d-77b1-4df0-ace1-13d55e9f5524 tempest-AttachVolumeNegativeTest-1303646863 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e', 'name': 'volume-c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3afd4d6f-da70-46b4-b56a-cf41bd0b0915', 'enforce_multipath': True} {{(pid=86854) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 14:33:23 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-11f3fb63-ed6c-4fe6-95ab-5453cd8429b8 req-fb71d13d-77b1-4df0-ace1-13d55e9f5524 tempest-AttachVolumeNegativeTest-1303646863 None] attachment_update completed successfully. Nov 06 14:33:23 devstack sudo[95717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-788ac09b-0d57-48eb-a0b6-96c5e7fe286f Nov 06 14:33:23 devstack sudo[95717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3c0e400f-5ccd-4779-801b-9150acefb039 tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "cinder-e60b838d-49f4-4ed1-a2f1-303b49969b25-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:33:24 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3c0e400f-5ccd-4779-801b-9150acefb039 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-e60b838d-49f4-4ed1-a2f1-303b49969b25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:33:24 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3c0e400f-5ccd-4779-801b-9150acefb039 tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "cinder-quobyte-40740ea6-ace4-4c50-8313-b797fc94bfe1" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:33:24 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3c0e400f-5ccd-4779-801b-9150acefb039 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-40740ea6-ace4-4c50-8313-b797fc94bfe1" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:33:24 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3c0e400f-5ccd-4779-801b-9150acefb039 tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "cinder-quobyte-e60b838d-49f4-4ed1-a2f1-303b49969b25" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:33:24 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3c0e400f-5ccd-4779-801b-9150acefb039 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-e60b838d-49f4-4ed1-a2f1-303b49969b25" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:33:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-3c0e400f-5ccd-4779-801b-9150acefb039 tempest-VolumesSnapshotTestJSON-254760034 None] Deleting offline snapshot e60b838d-49f4-4ed1-a2f1-303b49969b25 of volume 40740ea6-ace4-4c50-8313-b797fc94bfe1 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:33:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-3c0e400f-5ccd-4779-801b-9150acefb039 tempest-VolumesSnapshotTestJSON-254760034 None] snapshot_file for this snap is: volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.e60b838d-49f4-4ed1-a2f1-303b49969b25 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:33:24 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f037ad7-8c3b-41e2-9569-b9a4ff8f1919]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:33:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3c0e400f-5ccd-4779-801b-9150acefb039 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.e60b838d-49f4-4ed1-a2f1-303b49969b25 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:24 devstack sudo[95717]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-13e98c6e-6c6a-4d39-a8c7-6082e5a2e9af tempest-TestInstancesWithCinderVolumes-693752400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-788ac09b-0d57-48eb-a0b6-96c5e7fe286f" returned: 0 in 0.603s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-13e98c6e-6c6a-4d39-a8c7-6082e5a2e9af tempest-TestInstancesWithCinderVolumes-693752400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-788ac09b-0d57-48eb-a0b6-96c5e7fe286f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:24 devstack sudo[95822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.e60b838d-49f4-4ed1-a2f1-303b49969b25 Nov 06 14:33:24 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:24 devstack sudo[96140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-788ac09b-0d57-48eb-a0b6-96c5e7fe286f Nov 06 14:33:24 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:24 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-13e98c6e-6c6a-4d39-a8c7-6082e5a2e9af tempest-TestInstancesWithCinderVolumes-693752400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-788ac09b-0d57-48eb-a0b6-96c5e7fe286f" returned: 0 in 0.309s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:24 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-13e98c6e-6c6a-4d39-a8c7-6082e5a2e9af tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "cinder-quobyte-788ac09b-0d57-48eb-a0b6-96c5e7fe286f" released by "delete_volume" :: held 0.973s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:33:24 devstack cinder-volume[86854]: WARNING cinder.quota [None req-13e98c6e-6c6a-4d39-a8c7-6082e5a2e9af tempest-TestInstancesWithCinderVolumes-693752400 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1255797063-783817685 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1255797063-783817685, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:33:24 devstack cinder-volume[86854]: WARNING cinder.quota [None req-13e98c6e-6c6a-4d39-a8c7-6082e5a2e9af tempest-TestInstancesWithCinderVolumes-693752400 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1255797063-783817685 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1255797063-783817685, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:33:24 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3c0e400f-5ccd-4779-801b-9150acefb039 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.e60b838d-49f4-4ed1-a2f1-303b49969b25" returned: 0 in 0.572s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:24 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-13e98c6e-6c6a-4d39-a8c7-6082e5a2e9af tempest-TestInstancesWithCinderVolumes-693752400 None] Created reservations ['d9821a03-9b0d-481d-aa00-52118446a1b2', '2bd56232-0772-4448-bb0d-ad1695251ff3', '6856f04e-3722-448d-9122-48aaa7f06c2a', 'c8f967c0-36e2-48c2-a8ca-2e88f77715dd'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:33:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-3c0e400f-5ccd-4779-801b-9150acefb039 tempest-VolumesSnapshotTestJSON-254760034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40740ea6-ace4-4c50-8313-b797fc94bfe1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:33:24 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5446298-2348-4c39-acaf-703662ea227f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:33:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3c0e400f-5ccd-4779-801b-9150acefb039 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-13e98c6e-6c6a-4d39-a8c7-6082e5a2e9af tempest-TestInstancesWithCinderVolumes-693752400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:33:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-13e98c6e-6c6a-4d39-a8c7-6082e5a2e9af tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:33:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-13e98c6e-6c6a-4d39-a8c7-6082e5a2e9af tempest-TestInstancesWithCinderVolumes-693752400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:33:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-13e98c6e-6c6a-4d39-a8c7-6082e5a2e9af tempest-TestInstancesWithCinderVolumes-693752400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:33:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-13e98c6e-6c6a-4d39-a8c7-6082e5a2e9af tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:33:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-13e98c6e-6c6a-4d39-a8c7-6082e5a2e9af tempest-TestInstancesWithCinderVolumes-693752400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:24 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1 Nov 06 14:33:24 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:24 devstack sudo[96150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:33:24 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:25 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-13e98c6e-6c6a-4d39-a8c7-6082e5a2e9af tempest-TestInstancesWithCinderVolumes-693752400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.295s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:25 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-13e98c6e-6c6a-4d39-a8c7-6082e5a2e9af tempest-TestInstancesWithCinderVolumes-693752400 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:33:25 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-13e98c6e-6c6a-4d39-a8c7-6082e5a2e9af tempest-TestInstancesWithCinderVolumes-693752400 None] Deleted volume successfully. Nov 06 14:33:25 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-13e98c6e-6c6a-4d39-a8c7-6082e5a2e9af tempest-TestInstancesWithCinderVolumes-693752400 None] Lock "cinder-788ac09b-0d57-48eb-a0b6-96c5e7fe286f-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:33:25 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3c0e400f-5ccd-4779-801b-9150acefb039 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1" returned: 0 in 0.586s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3c0e400f-5ccd-4779-801b-9150acefb039 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.e60b838d-49f4-4ed1-a2f1-303b49969b25 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:25 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.e60b838d-49f4-4ed1-a2f1-303b49969b25 Nov 06 14:33:25 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:25 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3c0e400f-5ccd-4779-801b-9150acefb039 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.e60b838d-49f4-4ed1-a2f1-303b49969b25" returned: 0 in 0.452s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3c0e400f-5ccd-4779-801b-9150acefb039 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.e60b838d-49f4-4ed1-a2f1-303b49969b25 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:25 devstack sudo[96163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.e60b838d-49f4-4ed1-a2f1-303b49969b25 Nov 06 14:33:25 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:26 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3c0e400f-5ccd-4779-801b-9150acefb039 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1.e60b838d-49f4-4ed1-a2f1-303b49969b25" returned: 0 in 0.389s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:26 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3c0e400f-5ccd-4779-801b-9150acefb039 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-e60b838d-49f4-4ed1-a2f1-303b49969b25" released by "_delete_snapshot" :: held 2.238s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:33:26 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3c0e400f-5ccd-4779-801b-9150acefb039 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-40740ea6-ace4-4c50-8313-b797fc94bfe1" released by "delete_snapshot" :: held 2.294s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:33:26 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-3c0e400f-5ccd-4779-801b-9150acefb039 tempest-VolumesSnapshotTestJSON-254760034 None] Created reservations ['afb351b1-33af-437a-bb52-32b1a005c51f', '54db9059-b598-4b5f-a868-bc7ccdd2da92', '3039340e-502c-41bb-b446-51ca4603ac8b', '229f501b-e77d-4176-8f72-7dfffd3592d3'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:33:26 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-3c0e400f-5ccd-4779-801b-9150acefb039 tempest-VolumesSnapshotTestJSON-254760034 None] Delete snapshot completed successfully. Nov 06 14:33:26 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3c0e400f-5ccd-4779-801b-9150acefb039 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-e60b838d-49f4-4ed1-a2f1-303b49969b25-delete_snapshot" released by "delete_snapshot" :: held 2.504s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:33:27 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4d33bdc0-5cc5-466c-8db0-d57e3dd82dc4 tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "cinder-40740ea6-ace4-4c50-8313-b797fc94bfe1-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:33:27 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4d33bdc0-5cc5-466c-8db0-d57e3dd82dc4 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-40740ea6-ace4-4c50-8313-b797fc94bfe1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:33:27 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4d33bdc0-5cc5-466c-8db0-d57e3dd82dc4 tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "cinder-quobyte-40740ea6-ace4-4c50-8313-b797fc94bfe1" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:33:27 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4d33bdc0-5cc5-466c-8db0-d57e3dd82dc4 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-40740ea6-ace4-4c50-8313-b797fc94bfe1" acquired by "delete_volume" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:33:27 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a541ecb-3076-4b17-b83c-c3d906b58851]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:33:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4d33bdc0-5cc5-466c-8db0-d57e3dd82dc4 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:27 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1 Nov 06 14:33:27 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:27 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4d33bdc0-5cc5-466c-8db0-d57e3dd82dc4 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1" returned: 0 in 0.423s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4d33bdc0-5cc5-466c-8db0-d57e3dd82dc4 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:27 devstack sudo[96188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1 Nov 06 14:33:27 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:28 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4d33bdc0-5cc5-466c-8db0-d57e3dd82dc4 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-40740ea6-ace4-4c50-8313-b797fc94bfe1" returned: 0 in 0.326s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4d33bdc0-5cc5-466c-8db0-d57e3dd82dc4 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-40740ea6-ace4-4c50-8313-b797fc94bfe1" released by "delete_volume" :: held 0.831s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:33:28 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-4d33bdc0-5cc5-466c-8db0-d57e3dd82dc4 tempest-VolumesSnapshotTestJSON-254760034 None] Created reservations ['fa006cf1-b0f0-47d9-81a1-b839ac5cdae3', 'e98293a0-2c1a-4eef-92fa-0b9ffcf20c45', 'edc213c3-d550-416c-8a45-05e3416eca49', '15a1fabe-06a5-4bfc-b521-b69d5366eb37'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:33:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4d33bdc0-5cc5-466c-8db0-d57e3dd82dc4 tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:33:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4d33bdc0-5cc5-466c-8db0-d57e3dd82dc4 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:33:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4d33bdc0-5cc5-466c-8db0-d57e3dd82dc4 tempest-VolumesSnapshotTestJSON-254760034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:33:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4d33bdc0-5cc5-466c-8db0-d57e3dd82dc4 tempest-VolumesSnapshotTestJSON-254760034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:33:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4d33bdc0-5cc5-466c-8db0-d57e3dd82dc4 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:33:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4d33bdc0-5cc5-466c-8db0-d57e3dd82dc4 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:28 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:33:28 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:28 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4d33bdc0-5cc5-466c-8db0-d57e3dd82dc4 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.295s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:28 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-4d33bdc0-5cc5-466c-8db0-d57e3dd82dc4 tempest-VolumesSnapshotTestJSON-254760034 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:33:28 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-4d33bdc0-5cc5-466c-8db0-d57e3dd82dc4 tempest-VolumesSnapshotTestJSON-254760034 None] Deleted volume successfully. Nov 06 14:33:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4d33bdc0-5cc5-466c-8db0-d57e3dd82dc4 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-40740ea6-ace4-4c50-8313-b797fc94bfe1-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:33:29 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:33:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Flow 'volume_create_manager' (735167cb-2f92-4c7e-a6c4-6ac5bda640db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:33:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee876a3c-fa81-465b-b893-12e908858999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee876a3c-fa81-465b-b893-12e908858999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2080192468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8697f74971c4cbead991fd9584b63fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:33:29Z,use_quota=True,user_id='82c7dbba21c94d2586d9ea0de9415d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa7feb4-ac8f-4fb9-b35c-20de226edecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa7feb4-ac8f-4fb9-b35c-20de226edecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (595561e6-f993-4426-9f0f-ec3e38695b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (595561e6-f993-4426-9f0f-ec3e38695b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3', 'volume_name': 'volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b9ad663-6a68-4843-a290-99de579c2828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b9ad663-6a68-4843-a290-99de579c2828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff6d5099-cecb-4c0a-9fe5-6565741c6610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:29 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Volume ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3', 'volume_size': 1} Nov 06 14:33:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:33:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:33:29 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2080192468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8697f74971c4cbead991fd9584b63fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:33:29Z,use_quota=True,user_id='82c7dbba21c94d2586d9ea0de9415d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:33:29 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Creating volume ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:33:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:33:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:33:29 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:33:29 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:33:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:33:29 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:33:29 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:33:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:29 devstack sudo[96195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3 1073741824 Nov 06 14:33:29 devstack sudo[96195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:29 devstack sudo[96195]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3 1073741824" returned: 0 in 0.715s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:30 devstack sudo[96223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3 Nov 06 14:33:30 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:30 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3" returned: 0 in 0.429s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:30 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:33:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:33:30 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff6d5099-cecb-4c0a-9fe5-6565741c6610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:30 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df69d01b-c9de-4b9e-90a5-66534b92c2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:30 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Volume volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3 (ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3): created successfully Nov 06 14:33:30 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df69d01b-c9de-4b9e-90a5-66534b92c2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:30 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Flow 'volume_create_manager' (735167cb-2f92-4c7e-a6c4-6ac5bda640db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:33:30 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-5affd1d9-6d74-498c-a968-a741f477e502 tempest-VolumesSnapshotTestJSON-254760034 None] Created volume successfully. Nov 06 14:33:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6ba0c62c-9366-4b2c-998a-4b18fd0c522a tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:33:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6ba0c62c-9366-4b2c-998a-4b18fd0c522a tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.011s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:33:31 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-6ba0c62c-9366-4b2c-998a-4b18fd0c522a tempest-VolumesSnapshotTestJSON-254760034 None] Creating offline snapshot bdaa19bd-5b5b-485d-858f-6d7f0852509a of volume ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:33:31 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[235750a6-667e-435b-bff3-cd806c0775a5]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:33:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6ba0c62c-9366-4b2c-998a-4b18fd0c522a tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:32 devstack sudo[96276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3 Nov 06 14:33:32 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:32 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6ba0c62c-9366-4b2c-998a-4b18fd0c522a tempest-VolumesSnapshotTestJSON-254760034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3" returned: 0 in 0.913s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6ba0c62c-9366-4b2c-998a-4b18fd0c522a tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.bdaa19bd-5b5b-485d-858f-6d7f0852509a 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:32 devstack sudo[96283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.bdaa19bd-5b5b-485d-858f-6d7f0852509a 1G Nov 06 14:33:32 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:33 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6ba0c62c-9366-4b2c-998a-4b18fd0c522a tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.bdaa19bd-5b5b-485d-858f-6d7f0852509a 1G" returned: 0 in 0.918s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6ba0c62c-9366-4b2c-998a-4b18fd0c522a tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.bdaa19bd-5b5b-485d-858f-6d7f0852509a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:33 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.bdaa19bd-5b5b-485d-858f-6d7f0852509a Nov 06 14:33:33 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:34 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6ba0c62c-9366-4b2c-998a-4b18fd0c522a tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.bdaa19bd-5b5b-485d-858f-6d7f0852509a" returned: 0 in 0.716s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:34 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-6ba0c62c-9366-4b2c-998a-4b18fd0c522a tempest-VolumesSnapshotTestJSON-254760034 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.bdaa19bd-5b5b-485d-858f-6d7f0852509a is being set with open permissions: ugo+rw Nov 06 14:33:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6ba0c62c-9366-4b2c-998a-4b18fd0c522a tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.bdaa19bd-5b5b-485d-858f-6d7f0852509a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:34 devstack sudo[96298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.bdaa19bd-5b5b-485d-858f-6d7f0852509a Nov 06 14:33:34 devstack sudo[96298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:34 devstack sudo[96298]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6ba0c62c-9366-4b2c-998a-4b18fd0c522a tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.bdaa19bd-5b5b-485d-858f-6d7f0852509a" returned: 0 in 0.357s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6ba0c62c-9366-4b2c-998a-4b18fd0c522a tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:34 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.info Nov 06 14:33:34 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:35 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6ba0c62c-9366-4b2c-998a-4b18fd0c522a tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.info" returned: 0 in 0.481s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:35 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-6ba0c62c-9366-4b2c-998a-4b18fd0c522a tempest-VolumesSnapshotTestJSON-254760034 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.info is being set with open permissions: ugo+rw Nov 06 14:33:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6ba0c62c-9366-4b2c-998a-4b18fd0c522a tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:35 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.info Nov 06 14:33:35 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:35 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6ba0c62c-9366-4b2c-998a-4b18fd0c522a tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.info" returned: 0 in 0.458s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6ba0c62c-9366-4b2c-998a-4b18fd0c522a tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.114s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:33:35 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-6ba0c62c-9366-4b2c-998a-4b18fd0c522a tempest-VolumesSnapshotTestJSON-254760034 None] Create snapshot completed successfully Nov 06 14:33:36 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:33:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Flow 'volume_create_manager' (66ed3c39-8b46-47df-baa6-afb3255f0b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:33:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77611402-b602-4aeb-9bf4-476b475d552d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77611402-b602-4aeb-9bf4-476b475d552d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-395115840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d1e7867-c1bd-4a84-b53e-4e12d30c9f41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8697f74971c4cbead991fd9584b63fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bdaa19bd-5b5b-485d-858f-6d7f0852509a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:33:37Z,use_quota=True,user_id='82c7dbba21c94d2586d9ea0de9415d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b35a5501-44f1-498c-beee-61cd6dd0c4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b35a5501-44f1-498c-beee-61cd6dd0c4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfbcf29c-1200-44b3-b236-9ba88c39f5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfbcf29c-1200-44b3-b236-9ba88c39f5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5d1e7867-c1bd-4a84-b53e-4e12d30c9f41', 'volume_name': 'volume-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41', 'volume_size': 1, 'snapshot_id': 'bdaa19bd-5b5b-485d-858f-6d7f0852509a'}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c618c9ba-f344-4c89-88d2-94bef0c1ea02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c618c9ba-f344-4c89-88d2-94bef0c1ea02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db0dfa54-1eac-48e3-82d2-dee53e2194fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:36 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Volume 5d1e7867-c1bd-4a84-b53e-4e12d30c9f41: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41', 'volume_size': 1, 'snapshot_id': 'bdaa19bd-5b5b-485d-858f-6d7f0852509a'} Nov 06 14:33:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:33:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:33:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "cinder-quobyte-bdaa19bd-5b5b-485d-858f-6d7f0852509a-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41" by "_create_volume_from_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:33:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-bdaa19bd-5b5b-485d-858f-6d7f0852509a-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:33:37 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Creating volume 5d1e7867-c1bd-4a84-b53e-4e12d30c9f41 from snapshot bdaa19bd-5b5b-485d-858f-6d7f0852509a {{(pid=86854) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 14:33:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:33:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:33:37 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:33:37 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:33:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:33:37 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:33:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "cinder-quobyte-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41" by "_copy_volume_from_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:33:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:33:37 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] snapshot: bdaa19bd-5b5b-485d-858f-6d7f0852509a, volume: 5d1e7867-c1bd-4a84-b53e-4e12d30c9f41, {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 14:33:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:33:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:33:37 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:33:37 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:33:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:33:37 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe714ca3-73d6-4a5f-8e4c-7debfa900edf]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:33:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.bdaa19bd-5b5b-485d-858f-6d7f0852509a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:37 devstack sudo[96320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.bdaa19bd-5b5b-485d-858f-6d7f0852509a Nov 06 14:33:37 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:37 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.bdaa19bd-5b5b-485d-858f-6d7f0852509a" returned: 0 in 0.624s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:37 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:33:37 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6a6df6-141f-4dc7-9bae-b0e4a9fb405d]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:33:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:38 devstack sudo[96326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3 Nov 06 14:33:38 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:38 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3" returned: 0 in 0.499s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3 {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 14:33:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Creating direct copy from snapshot {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 14:33:38 devstack cinder-volume[86854]: DEBUG cinder.utils [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Path /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41 not found in is_blk_device check {{(pid=86854) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 14:33:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:38 devstack sudo[96332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41 Nov 06 14:33:38 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:47 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=87,cinder:UPDATE=77,cinder:DELETE=8,cinder:INSERT=22 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:33:47 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:UPDATE=76,cinder:SELECT=91,cinder:INSERT=14,cinder:DELETE=5 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:33:50 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41" returned: 0 in 11.814s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:50 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Image conversion details: src /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3, size 1024.00 MB, duration 11.82 sec, destination /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41 {{(pid=86854) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 14:33:50 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Converted 1024.00 MB image at 86.67 MB/s Nov 06 14:33:50 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41 is being set with open permissions: ugo+rw Nov 06 14:33:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:50 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41 Nov 06 14:33:50 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:50 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41" returned: 0 in 0.367s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:50 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41" released by "_copy_volume_from_snapshot" :: held 13.460s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:33:50 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-bdaa19bd-5b5b-485d-858f-6d7f0852509a-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41" released by "_create_volume_from_snapshot" :: held 13.611s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:33:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.659s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:33:50 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db0dfa54-1eac-48e3-82d2-dee53e2194fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41', 'volume_size': 1, 'snapshot_id': 'bdaa19bd-5b5b-485d-858f-6d7f0852509a'}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:50 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (662d0f32-4944-4e56-9d39-1faec6ff00f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:33:50 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Volume volume-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41 (5d1e7867-c1bd-4a84-b53e-4e12d30c9f41): created successfully Nov 06 14:33:50 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (662d0f32-4944-4e56-9d39-1faec6ff00f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:33:50 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Flow 'volume_create_manager' (66ed3c39-8b46-47df-baa6-afb3255f0b40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:33:50 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-2bb2d0f4-513c-491f-8003-e40e98179b3d tempest-VolumesSnapshotTestJSON-254760034 None] Created volume successfully. Nov 06 14:33:51 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-be752816-0292-489b-b4a6-f69fb353c912 tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "cinder-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:33:51 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-be752816-0292-489b-b4a6-f69fb353c912 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:33:51 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-be752816-0292-489b-b4a6-f69fb353c912 tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "cinder-quobyte-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:33:51 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-be752816-0292-489b-b4a6-f69fb353c912 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41" acquired by "delete_volume" :: waited 0.034s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:33:51 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e369ce-7d63-444e-9f0d-65d26be7c5d5]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:33:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-be752816-0292-489b-b4a6-f69fb353c912 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:51 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41 Nov 06 14:33:51 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:52 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-be752816-0292-489b-b4a6-f69fb353c912 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41" returned: 0 in 0.481s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-be752816-0292-489b-b4a6-f69fb353c912 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:52 devstack sudo[96453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41 Nov 06 14:33:52 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:52 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-be752816-0292-489b-b4a6-f69fb353c912 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41" returned: 0 in 0.334s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:52 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-be752816-0292-489b-b4a6-f69fb353c912 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41" released by "delete_volume" :: held 0.882s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:33:52 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-be752816-0292-489b-b4a6-f69fb353c912 tempest-VolumesSnapshotTestJSON-254760034 None] Created reservations ['70c0551f-8cd8-4237-9cac-0b740f4e72d9', '0a6bac14-5939-4f05-90e9-518e9b2c41d0', 'e08f0576-6581-428f-a915-c0d6db3c07c8', '251c1828-c41b-433b-8cc0-ef136cbc64b1'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:33:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-be752816-0292-489b-b4a6-f69fb353c912 tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:33:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-be752816-0292-489b-b4a6-f69fb353c912 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:33:52 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-be752816-0292-489b-b4a6-f69fb353c912 tempest-VolumesSnapshotTestJSON-254760034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:33:52 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-be752816-0292-489b-b4a6-f69fb353c912 tempest-VolumesSnapshotTestJSON-254760034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:33:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-be752816-0292-489b-b4a6-f69fb353c912 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:33:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-be752816-0292-489b-b4a6-f69fb353c912 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:52 devstack sudo[96456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:33:52 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bd4c98d7-9c04-4ec8-ba8a-5c4cfa4cd255 tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "cinder-bdaa19bd-5b5b-485d-858f-6d7f0852509a-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:33:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bd4c98d7-9c04-4ec8-ba8a-5c4cfa4cd255 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-bdaa19bd-5b5b-485d-858f-6d7f0852509a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:33:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bd4c98d7-9c04-4ec8-ba8a-5c4cfa4cd255 tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "cinder-quobyte-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:33:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bd4c98d7-9c04-4ec8-ba8a-5c4cfa4cd255 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:33:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bd4c98d7-9c04-4ec8-ba8a-5c4cfa4cd255 tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "cinder-quobyte-bdaa19bd-5b5b-485d-858f-6d7f0852509a" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:33:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bd4c98d7-9c04-4ec8-ba8a-5c4cfa4cd255 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-bdaa19bd-5b5b-485d-858f-6d7f0852509a" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:33:53 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-bd4c98d7-9c04-4ec8-ba8a-5c4cfa4cd255 tempest-VolumesSnapshotTestJSON-254760034 None] Deleting offline snapshot bdaa19bd-5b5b-485d-858f-6d7f0852509a of volume ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:33:53 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-bd4c98d7-9c04-4ec8-ba8a-5c4cfa4cd255 tempest-VolumesSnapshotTestJSON-254760034 None] snapshot_file for this snap is: volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.bdaa19bd-5b5b-485d-858f-6d7f0852509a {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:33:53 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e13a8c6-49bd-4936-b58c-3a34962026eb]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:33:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bd4c98d7-9c04-4ec8-ba8a-5c4cfa4cd255 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.bdaa19bd-5b5b-485d-858f-6d7f0852509a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:53 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-be752816-0292-489b-b4a6-f69fb353c912 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.629s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:53 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-be752816-0292-489b-b4a6-f69fb353c912 tempest-VolumesSnapshotTestJSON-254760034 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:33:53 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-be752816-0292-489b-b4a6-f69fb353c912 tempest-VolumesSnapshotTestJSON-254760034 None] Deleted volume successfully. Nov 06 14:33:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-be752816-0292-489b-b4a6-f69fb353c912 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-5d1e7867-c1bd-4a84-b53e-4e12d30c9f41-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:33:53 devstack sudo[96458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.bdaa19bd-5b5b-485d-858f-6d7f0852509a Nov 06 14:33:53 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:53 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bd4c98d7-9c04-4ec8-ba8a-5c4cfa4cd255 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.bdaa19bd-5b5b-485d-858f-6d7f0852509a" returned: 0 in 0.577s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:53 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-bd4c98d7-9c04-4ec8-ba8a-5c4cfa4cd255 tempest-VolumesSnapshotTestJSON-254760034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:33:53 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e9246a-5bb9-48c3-9d81-c6873b2be55f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:33:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bd4c98d7-9c04-4ec8-ba8a-5c4cfa4cd255 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:54 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3 Nov 06 14:33:54 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:54 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bd4c98d7-9c04-4ec8-ba8a-5c4cfa4cd255 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3" returned: 0 in 0.799s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bd4c98d7-9c04-4ec8-ba8a-5c4cfa4cd255 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.bdaa19bd-5b5b-485d-858f-6d7f0852509a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:54 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.bdaa19bd-5b5b-485d-858f-6d7f0852509a Nov 06 14:33:54 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:55 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bd4c98d7-9c04-4ec8-ba8a-5c4cfa4cd255 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.bdaa19bd-5b5b-485d-858f-6d7f0852509a" returned: 0 in 0.380s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bd4c98d7-9c04-4ec8-ba8a-5c4cfa4cd255 tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.bdaa19bd-5b5b-485d-858f-6d7f0852509a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:55 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.bdaa19bd-5b5b-485d-858f-6d7f0852509a Nov 06 14:33:55 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:55 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bd4c98d7-9c04-4ec8-ba8a-5c4cfa4cd255 tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3.bdaa19bd-5b5b-485d-858f-6d7f0852509a" returned: 0 in 0.271s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:55 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bd4c98d7-9c04-4ec8-ba8a-5c4cfa4cd255 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-bdaa19bd-5b5b-485d-858f-6d7f0852509a" released by "_delete_snapshot" :: held 2.158s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:33:55 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bd4c98d7-9c04-4ec8-ba8a-5c4cfa4cd255 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3" released by "delete_snapshot" :: held 2.196s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:33:55 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-bd4c98d7-9c04-4ec8-ba8a-5c4cfa4cd255 tempest-VolumesSnapshotTestJSON-254760034 None] Created reservations ['9260ecd1-32a1-458b-aa29-0eca4143b96a', 'f29849dc-2fa8-48be-8c73-a84987ad3624', 'da955cf1-6212-4758-8517-0d991ad9c5aa', 'ddc3484d-5ea4-4baa-85a8-65a26d65871f'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:33:55 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-bd4c98d7-9c04-4ec8-ba8a-5c4cfa4cd255 tempest-VolumesSnapshotTestJSON-254760034 None] Delete snapshot completed successfully. Nov 06 14:33:55 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bd4c98d7-9c04-4ec8-ba8a-5c4cfa4cd255 tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-bdaa19bd-5b5b-485d-858f-6d7f0852509a-delete_snapshot" released by "delete_snapshot" :: held 2.399s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:33:56 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f0e762c3-2471-4578-9cbf-b4117095834b tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "cinder-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:33:56 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f0e762c3-2471-4578-9cbf-b4117095834b tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:33:56 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f0e762c3-2471-4578-9cbf-b4117095834b tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "cinder-quobyte-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:33:56 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f0e762c3-2471-4578-9cbf-b4117095834b tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3" acquired by "delete_volume" :: waited 0.023s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:33:56 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[6915a9b1-6313-48b1-afe3-f4935ea30dcc]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:33:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f0e762c3-2471-4578-9cbf-b4117095834b tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:56 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3 Nov 06 14:33:56 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:57 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f0e762c3-2471-4578-9cbf-b4117095834b tempest-VolumesSnapshotTestJSON-254760034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3" returned: 0 in 0.420s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f0e762c3-2471-4578-9cbf-b4117095834b tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:57 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3 Nov 06 14:33:57 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:57 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f0e762c3-2471-4578-9cbf-b4117095834b tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3" returned: 0 in 0.279s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:57 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f0e762c3-2471-4578-9cbf-b4117095834b tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3" released by "delete_volume" :: held 0.777s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:33:57 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-f0e762c3-2471-4578-9cbf-b4117095834b tempest-VolumesSnapshotTestJSON-254760034 None] Created reservations ['77954413-9aa3-493b-ad22-318da837b208', '93582adb-911e-4e45-913e-d3f71f265303', 'd35b4398-6f1f-4756-814b-314026c6845e', 'c2d4da00-6b5e-49bb-b158-ff9a0cdbee62'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:33:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f0e762c3-2471-4578-9cbf-b4117095834b tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:33:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f0e762c3-2471-4578-9cbf-b4117095834b tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:33:57 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f0e762c3-2471-4578-9cbf-b4117095834b tempest-VolumesSnapshotTestJSON-254760034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:33:57 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f0e762c3-2471-4578-9cbf-b4117095834b tempest-VolumesSnapshotTestJSON-254760034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:33:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f0e762c3-2471-4578-9cbf-b4117095834b tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:33:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f0e762c3-2471-4578-9cbf-b4117095834b tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:57 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:33:57 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:57 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a8b52882-8c40-4fe4-a92c-b4965bde127c tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "cinder-56925201-13ef-42ed-ad6a-f27e2934883b-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:33:57 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f0e762c3-2471-4578-9cbf-b4117095834b tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.297s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:57 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-f0e762c3-2471-4578-9cbf-b4117095834b tempest-VolumesSnapshotTestJSON-254760034 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:33:57 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a8b52882-8c40-4fe4-a92c-b4965bde127c tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-56925201-13ef-42ed-ad6a-f27e2934883b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:33:57 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-f0e762c3-2471-4578-9cbf-b4117095834b tempest-VolumesSnapshotTestJSON-254760034 None] Deleted volume successfully. Nov 06 14:33:57 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f0e762c3-2471-4578-9cbf-b4117095834b tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-ba42f7c2-6ed0-4b05-9fc6-19f75e5d74e3-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:33:57 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a8b52882-8c40-4fe4-a92c-b4965bde127c tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "cinder-quobyte-56925201-13ef-42ed-ad6a-f27e2934883b" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:33:57 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a8b52882-8c40-4fe4-a92c-b4965bde127c tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-56925201-13ef-42ed-ad6a-f27e2934883b" acquired by "delete_volume" :: waited 0.020s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:33:58 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e553d3-d65b-43fe-82a6-c494864db46d]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:33:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a8b52882-8c40-4fe4-a92c-b4965bde127c tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:58 devstack sudo[96512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b Nov 06 14:33:58 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:58 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a8b52882-8c40-4fe4-a92c-b4965bde127c tempest-VolumesSnapshotTestJSON-254760034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b" returned: 0 in 0.365s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a8b52882-8c40-4fe4-a92c-b4965bde127c tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:58 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b Nov 06 14:33:58 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:58 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a8b52882-8c40-4fe4-a92c-b4965bde127c tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56925201-13ef-42ed-ad6a-f27e2934883b" returned: 0 in 0.321s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:58 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a8b52882-8c40-4fe4-a92c-b4965bde127c tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-quobyte-56925201-13ef-42ed-ad6a-f27e2934883b" released by "delete_volume" :: held 0.777s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:33:58 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-a8b52882-8c40-4fe4-a92c-b4965bde127c tempest-VolumesSnapshotTestJSON-254760034 None] Created reservations ['a578a4c8-0906-493c-8c42-787117098f84', 'bb78e703-789b-48e5-b590-db5b21e1768a', '6795fd24-538f-4b23-8a7c-9bcc8b10531e', '3ce5e9c7-097e-4027-85a0-22fa8a3ce4c7'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:33:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a8b52882-8c40-4fe4-a92c-b4965bde127c tempest-VolumesSnapshotTestJSON-254760034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:33:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a8b52882-8c40-4fe4-a92c-b4965bde127c tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:33:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a8b52882-8c40-4fe4-a92c-b4965bde127c tempest-VolumesSnapshotTestJSON-254760034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:33:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a8b52882-8c40-4fe4-a92c-b4965bde127c tempest-VolumesSnapshotTestJSON-254760034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:33:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a8b52882-8c40-4fe4-a92c-b4965bde127c tempest-VolumesSnapshotTestJSON-254760034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:33:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a8b52882-8c40-4fe4-a92c-b4965bde127c tempest-VolumesSnapshotTestJSON-254760034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:33:58 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:33:58 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:33:59 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Nov 06 14:33:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a8b52882-8c40-4fe4-a92c-b4965bde127c tempest-VolumesSnapshotTestJSON-254760034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.257s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:33:59 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-a8b52882-8c40-4fe4-a92c-b4965bde127c tempest-VolumesSnapshotTestJSON-254760034 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:33:59 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-a8b52882-8c40-4fe4-a92c-b4965bde127c tempest-VolumesSnapshotTestJSON-254760034 None] Deleted volume successfully. Nov 06 14:33:59 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a8b52882-8c40-4fe4-a92c-b4965bde127c tempest-VolumesSnapshotTestJSON-254760034 None] Lock "cinder-56925201-13ef-42ed-ad6a-f27e2934883b-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:34:00 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:34:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Flow 'volume_create_manager' (b527d122-6cb9-4115-aa51-29ad26155a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:34:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afaa978e-e401-4cbc-8a7a-8830417ded0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afaa978e-e401-4cbc-8a7a-8830417ded0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2027600409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aed039f1ea3d4670bcad85a8c900161a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:34:00Z,use_quota=True,user_id='1e321f974dc0481b8f0e197a711d632f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf31fbc4-7d0d-4a91-bab1-beda4b2cc3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf31fbc4-7d0d-4a91-bab1-beda4b2cc3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206037cc-b04d-4a0b-bdc4-3dd19d0d7fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206037cc-b04d-4a0b-bdc4-3dd19d0d7fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a', 'volume_name': 'volume-d8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2896ef-97fc-4204-9a15-86cfb7545069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2896ef-97fc-4204-9a15-86cfb7545069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e357013-80c6-43ec-8252-8bfd2fbf6b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:00 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Volume d8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a', 'volume_size': 1} Nov 06 14:34:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:34:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:34:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2027600409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aed039f1ea3d4670bcad85a8c900161a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:34:00Z,use_quota=True,user_id='1e321f974dc0481b8f0e197a711d632f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:34:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Creating volume d8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:34:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:34:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:34:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:34:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:34:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:34:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:34:00 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:34:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:00 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a 1073741824 Nov 06 14:34:00 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:34:00 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Nov 06 14:34:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a 1073741824" returned: 0 in 0.530s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:34:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:01 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a Nov 06 14:34:01 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:34:01 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Nov 06 14:34:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a" returned: 0 in 0.283s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:34:01 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:34:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:34:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e357013-80c6-43ec-8252-8bfd2fbf6b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eeb5c56-36df-43bc-ade5-4c3f3069c51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:01 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Volume volume-d8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a (d8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a): created successfully Nov 06 14:34:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eeb5c56-36df-43bc-ade5-4c3f3069c51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Flow 'volume_create_manager' (b527d122-6cb9-4115-aa51-29ad26155a2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:34:01 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-10d0be48-a191-4760-8646-e1dc594e3f54 tempest-AttachVolumeTestJSON-100281132 None] Created volume successfully. Nov 06 14:34:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-e2872f58-f9c9-47ba-8bcb-1e75cc5ddff5 req-82f8c4c8-08a5-42fe-bde1-5bf99e1dcc4a tempest-AttachVolumeTestJSON-100281132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:34:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-e2872f58-f9c9-47ba-8bcb-1e75cc5ddff5 req-82f8c4c8-08a5-42fe-bde1-5bf99e1dcc4a tempest-AttachVolumeTestJSON-100281132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:34:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-e2872f58-f9c9-47ba-8bcb-1e75cc5ddff5 req-82f8c4c8-08a5-42fe-bde1-5bf99e1dcc4a tempest-AttachVolumeTestJSON-100281132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:34:03 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-e2872f58-f9c9-47ba-8bcb-1e75cc5ddff5 req-82f8c4c8-08a5-42fe-bde1-5bf99e1dcc4a tempest-AttachVolumeTestJSON-100281132 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e', 'name': 'volume-d8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'caf3f540-bd84-4ca2-a68e-631bc79c4774', 'enforce_multipath': True} {{(pid=86854) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 14:34:03 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-e2872f58-f9c9-47ba-8bcb-1e75cc5ddff5 req-82f8c4c8-08a5-42fe-bde1-5bf99e1dcc4a tempest-AttachVolumeTestJSON-100281132 None] attachment_update completed successfully. Nov 06 14:34:06 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:34:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Flow 'volume_create_manager' (3737e07d-a056-4bf5-b6a1-e7f50b84c2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:34:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5332f2c-33d3-44f1-a02f-b38f4f1e4a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5332f2c-33d3-44f1-a02f-b38f4f1e4a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-500443107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0415bc6b-6a73-480e-bb0a-c58bd08686b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aed039f1ea3d4670bcad85a8c900161a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:34:06Z,use_quota=True,user_id='1e321f974dc0481b8f0e197a711d632f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a812dd-3f5f-4560-bdd2-db27f7753148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a812dd-3f5f-4560-bdd2-db27f7753148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f2abef-0cec-4fc9-8320-76f958f120bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f2abef-0cec-4fc9-8320-76f958f120bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0415bc6b-6a73-480e-bb0a-c58bd08686b4', 'volume_name': 'volume-0415bc6b-6a73-480e-bb0a-c58bd08686b4', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4989c696-440f-403c-a76e-20ad96bfd216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4989c696-440f-403c-a76e-20ad96bfd216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f8455d-386e-47a1-9540-8c61c2a8040b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:06 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Volume 0415bc6b-6a73-480e-bb0a-c58bd08686b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0415bc6b-6a73-480e-bb0a-c58bd08686b4', 'volume_size': 1} Nov 06 14:34:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:34:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:34:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-500443107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0415bc6b-6a73-480e-bb0a-c58bd08686b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aed039f1ea3d4670bcad85a8c900161a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:34:06Z,use_quota=True,user_id='1e321f974dc0481b8f0e197a711d632f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:34:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Creating volume 0415bc6b-6a73-480e-bb0a-c58bd08686b4 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:34:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:34:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:34:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:34:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:34:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:34:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:34:06 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:34:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0415bc6b-6a73-480e-bb0a-c58bd08686b4 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:06 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0415bc6b-6a73-480e-bb0a-c58bd08686b4 1073741824 Nov 06 14:34:06 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:34:06 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Nov 06 14:34:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0415bc6b-6a73-480e-bb0a-c58bd08686b4 1073741824" returned: 0 in 0.525s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:34:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0415bc6b-6a73-480e-bb0a-c58bd08686b4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:06 devstack sudo[96598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0415bc6b-6a73-480e-bb0a-c58bd08686b4 Nov 06 14:34:06 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:34:07 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root Nov 06 14:34:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0415bc6b-6a73-480e-bb0a-c58bd08686b4" returned: 0 in 0.298s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:34:07 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:34:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:34:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f8455d-386e-47a1-9540-8c61c2a8040b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0415bc6b-6a73-480e-bb0a-c58bd08686b4', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c74ae87e-9fe4-4dc0-bcb1-05012fc62439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:07 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Volume volume-0415bc6b-6a73-480e-bb0a-c58bd08686b4 (0415bc6b-6a73-480e-bb0a-c58bd08686b4): created successfully Nov 06 14:34:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c74ae87e-9fe4-4dc0-bcb1-05012fc62439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Flow 'volume_create_manager' (3737e07d-a056-4bf5-b6a1-e7f50b84c2b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:34:07 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-3f92ecae-120d-4c60-ab48-b2f52d73e348 tempest-AttachVolumeTestJSON-100281132 None] Created volume successfully. Nov 06 14:34:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-5f915b2a-dfa3-407b-be94-4027811f0d94 req-07061a23-a90d-48d1-bd36-467bbc8e8782 tempest-AttachVolumeTestJSON-100281132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:34:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-5f915b2a-dfa3-407b-be94-4027811f0d94 req-07061a23-a90d-48d1-bd36-467bbc8e8782 tempest-AttachVolumeTestJSON-100281132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:34:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-5f915b2a-dfa3-407b-be94-4027811f0d94 req-07061a23-a90d-48d1-bd36-467bbc8e8782 tempest-AttachVolumeTestJSON-100281132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:34:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-5f915b2a-dfa3-407b-be94-4027811f0d94 req-07061a23-a90d-48d1-bd36-467bbc8e8782 tempest-AttachVolumeTestJSON-100281132 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e', 'name': 'volume-0415bc6b-6a73-480e-bb0a-c58bd08686b4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '691aa050-8237-49cd-80a1-3275ae69f2ba', 'enforce_multipath': True} {{(pid=86854) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 14:34:09 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-5f915b2a-dfa3-407b-be94-4027811f0d94 req-07061a23-a90d-48d1-bd36-467bbc8e8782 tempest-AttachVolumeTestJSON-100281132 None] attachment_update completed successfully. Nov 06 14:34:11 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-0aa3eade-968b-48f4-b99f-6817a82c5995 req-ac5d6a45-4cfa-4841-98a9-cdd1cc6d8f20 tempest-AttachVolumeTestJSON-100281132 None] Terminate volume connection completed successfully. Nov 06 14:34:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-0aa3eade-968b-48f4-b99f-6817a82c5995 req-ac5d6a45-4cfa-4841-98a9-cdd1cc6d8f20 tempest-AttachVolumeTestJSON-100281132 None] Deleting attachment caf3f540-bd84-4ca2-a68e-631bc79c4774. {{(pid=86854) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 14:34:12 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-c8f6295e-ec2d-474b-bdaa-970727c984ac req-08935a1f-6684-4a92-b978-2c25208fb8e8 tempest-AttachVolumeTestJSON-100281132 None] Terminate volume connection completed successfully. Nov 06 14:34:12 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-c8f6295e-ec2d-474b-bdaa-970727c984ac req-08935a1f-6684-4a92-b978-2c25208fb8e8 tempest-AttachVolumeTestJSON-100281132 None] Deleting attachment 691aa050-8237-49cd-80a1-3275ae69f2ba. {{(pid=86854) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 14:34:21 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=37,cinder:UPDATE=42,cinder:INSERT=10,cinder:DELETE=2 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:34:22 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=45,cinder:UPDATE=40,cinder:DELETE=4,cinder:INSERT=9 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:23 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:34:23 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:34:23 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.358s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager._thread_info {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread count: 28 {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread info: [<_MainThread(MainThread, started 130306900594816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Flow 'volume_create_manager' (96b53dd3-7658-4cb8-9e66-0e5320769479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be3ac11f-b842-4e2e-a019-4e3d716ddb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be3ac11f-b842-4e2e-a019-4e3d716ddb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1948674558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb498a9-9cde-439d-9998-335568ac7aef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='633de685c14d468dad9bf28d88b4cb23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:34:24Z,use_quota=True,user_id='015cc8f6a31b43db843e86f3f0e7139e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe1ea1d-97b3-4e19-b6c2-11a8a5fd1eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe1ea1d-97b3-4e19-b6c2-11a8a5fd1eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f656be5-bb2b-437f-9450-4b061c51f5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f656be5-bb2b-437f-9450-4b061c51f5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeb498a9-9cde-439d-9998-335568ac7aef', 'volume_name': 'volume-aeb498a9-9cde-439d-9998-335568ac7aef', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b310bb27-1b25-4b1d-a1dd-09708f7c574d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b310bb27-1b25-4b1d-a1dd-09708f7c574d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e46cf2-dadb-452a-aafc-619b586a940b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:23 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Volume aeb498a9-9cde-439d-9998-335568ac7aef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeb498a9-9cde-439d-9998-335568ac7aef', 'volume_size': 1} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1948674558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb498a9-9cde-439d-9998-335568ac7aef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='633de685c14d468dad9bf28d88b4cb23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:34:24Z,use_quota=True,user_id='015cc8f6a31b43db843e86f3f0e7139e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Creating volume aeb498a9-9cde-439d-9998-335568ac7aef {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:34:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:34:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:34:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:34:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:34:24 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:34:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aeb498a9-9cde-439d-9998-335568ac7aef 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:24 devstack sudo[96708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aeb498a9-9cde-439d-9998-335568ac7aef 1073741824 Nov 06 14:34:24 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:34:24 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:34:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Flow 'volume_create_manager' (b1a1c1e5-4e32-48ae-9dc5-f1e450c8343e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:34:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0704679a-66de-4e70-ac43-386ab36c2e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0704679a-66de-4e70-ac43-386ab36c2e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-883494463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16cd4667-5861-44a0-be4f-8f3685e531bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='633de685c14d468dad9bf28d88b4cb23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:34:24Z,use_quota=True,user_id='015cc8f6a31b43db843e86f3f0e7139e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f345bb8-311d-494a-a407-ec84a0845ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f345bb8-311d-494a-a407-ec84a0845ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99451737-9bfb-4154-ad1d-325dfdbacdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99451737-9bfb-4154-ad1d-325dfdbacdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16cd4667-5861-44a0-be4f-8f3685e531bb', 'volume_name': 'volume-16cd4667-5861-44a0-be4f-8f3685e531bb', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53cffda5-4529-4ef7-831a-7292e22414e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53cffda5-4529-4ef7-831a-7292e22414e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (555ffee4-f753-43be-8ab4-8b217890dc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:24 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Volume 16cd4667-5861-44a0-be4f-8f3685e531bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16cd4667-5861-44a0-be4f-8f3685e531bb', 'volume_size': 1} Nov 06 14:34:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:34:24 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root Nov 06 14:34:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aeb498a9-9cde-439d-9998-335568ac7aef 1073741824" returned: 0 in 0.676s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:34:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aeb498a9-9cde-439d-9998-335568ac7aef {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:24 devstack sudo[96715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aeb498a9-9cde-439d-9998-335568ac7aef Nov 06 14:34:24 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:34:24 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root Nov 06 14:34:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aeb498a9-9cde-439d-9998-335568ac7aef" returned: 0 in 0.259s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:34:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:34:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:34:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.359s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:34:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-883494463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16cd4667-5861-44a0-be4f-8f3685e531bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='633de685c14d468dad9bf28d88b4cb23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:34:24Z,use_quota=True,user_id='015cc8f6a31b43db843e86f3f0e7139e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:34:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Creating volume 16cd4667-5861-44a0-be4f-8f3685e531bb {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:34:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:34:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:34:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:34:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:34:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:34:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:34:25 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:34:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-16cd4667-5861-44a0-be4f-8f3685e531bb 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e46cf2-dadb-452a-aafc-619b586a940b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeb498a9-9cde-439d-9998-335568ac7aef', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (647bba05-91af-4b57-8d18-a6e20016f018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:25 devstack sudo[96718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-16cd4667-5861-44a0-be4f-8f3685e531bb 1073741824 Nov 06 14:34:25 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:34:25 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Volume volume-aeb498a9-9cde-439d-9998-335568ac7aef (aeb498a9-9cde-439d-9998-335568ac7aef): created successfully Nov 06 14:34:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (647bba05-91af-4b57-8d18-a6e20016f018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Flow 'volume_create_manager' (96b53dd3-7658-4cb8-9e66-0e5320769479) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:34:25 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-e0174c45-ed11-4b4c-9817-1a743ee94afb tempest-TestServerVolumeAttachmentScenario-346953665 None] Created volume successfully. Nov 06 14:34:25 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root Nov 06 14:34:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-16cd4667-5861-44a0-be4f-8f3685e531bb 1073741824" returned: 0 in 0.561s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:34:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-16cd4667-5861-44a0-be4f-8f3685e531bb {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:25 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-16cd4667-5861-44a0-be4f-8f3685e531bb Nov 06 14:34:25 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:34:25 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Nov 06 14:34:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-16cd4667-5861-44a0-be4f-8f3685e531bb" returned: 0 in 0.280s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:34:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:34:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:34:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (555ffee4-f753-43be-8ab4-8b217890dc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16cd4667-5861-44a0-be4f-8f3685e531bb', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da456bb5-900a-4e68-952a-45888cfb3721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:25 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Volume volume-16cd4667-5861-44a0-be4f-8f3685e531bb (16cd4667-5861-44a0-be4f-8f3685e531bb): created successfully Nov 06 14:34:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da456bb5-900a-4e68-952a-45888cfb3721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Flow 'volume_create_manager' (b1a1c1e5-4e32-48ae-9dc5-f1e450c8343e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:34:25 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-9a9b7bf7-a13f-4046-b908-05744a1e5abc tempest-TestServerVolumeAttachmentScenario-346953665 None] Created volume successfully. Nov 06 14:34:26 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-eb9e284b-0421-46fc-8d72-c5d4560e6f3d req-91e3df18-2698-4ec8-963f-d61f21b24c3c tempest-AttachVolumeNegativeTest-1303646863 None] Terminate volume connection completed successfully. Nov 06 14:34:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-eb9e284b-0421-46fc-8d72-c5d4560e6f3d req-91e3df18-2698-4ec8-963f-d61f21b24c3c tempest-AttachVolumeNegativeTest-1303646863 None] Deleting attachment 3afd4d6f-da70-46b4-b56a-cf41bd0b0915. {{(pid=86854) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 14:34:26 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-39643d25-8061-4a2f-911f-e219318b4ac2 tempest-AttachVolumeTestJSON-100281132 None] Acquiring lock "cinder-0415bc6b-6a73-480e-bb0a-c58bd08686b4-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:34:26 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-39643d25-8061-4a2f-911f-e219318b4ac2 tempest-AttachVolumeTestJSON-100281132 None] Lock "cinder-0415bc6b-6a73-480e-bb0a-c58bd08686b4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:34:26 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-39643d25-8061-4a2f-911f-e219318b4ac2 tempest-AttachVolumeTestJSON-100281132 None] Acquiring lock "cinder-quobyte-0415bc6b-6a73-480e-bb0a-c58bd08686b4" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:34:26 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-39643d25-8061-4a2f-911f-e219318b4ac2 tempest-AttachVolumeTestJSON-100281132 None] Lock "cinder-quobyte-0415bc6b-6a73-480e-bb0a-c58bd08686b4" acquired by "delete_volume" :: waited 0.019s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:34:26 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[f362a2d2-ac0a-4b8d-a77d-73b20ef2bdb4]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:34:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-39643d25-8061-4a2f-911f-e219318b4ac2 tempest-AttachVolumeTestJSON-100281132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0415bc6b-6a73-480e-bb0a-c58bd08686b4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:26 devstack sudo[96731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0415bc6b-6a73-480e-bb0a-c58bd08686b4 Nov 06 14:34:26 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:34:27 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root Nov 06 14:34:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-39643d25-8061-4a2f-911f-e219318b4ac2 tempest-AttachVolumeTestJSON-100281132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0415bc6b-6a73-480e-bb0a-c58bd08686b4" returned: 0 in 0.455s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:34:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-39643d25-8061-4a2f-911f-e219318b4ac2 tempest-AttachVolumeTestJSON-100281132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0415bc6b-6a73-480e-bb0a-c58bd08686b4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:27 devstack sudo[96737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0415bc6b-6a73-480e-bb0a-c58bd08686b4 Nov 06 14:34:27 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:34:27 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root Nov 06 14:34:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-39643d25-8061-4a2f-911f-e219318b4ac2 tempest-AttachVolumeTestJSON-100281132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0415bc6b-6a73-480e-bb0a-c58bd08686b4" returned: 0 in 0.478s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:34:27 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-39643d25-8061-4a2f-911f-e219318b4ac2 tempest-AttachVolumeTestJSON-100281132 None] Lock "cinder-quobyte-0415bc6b-6a73-480e-bb0a-c58bd08686b4" released by "delete_volume" :: held 0.998s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:34:27 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-39643d25-8061-4a2f-911f-e219318b4ac2 tempest-AttachVolumeTestJSON-100281132 None] Created reservations ['1fce7533-8d03-4e38-bdf2-970de9d86775', '8aa3a065-d29e-4f44-9a1a-44f90832a18c', '3cd9226f-fbd0-4922-893d-01a3beac2a05', 'f3ea5596-994a-42eb-b18c-2fde5cd74e3a'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:34:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-39643d25-8061-4a2f-911f-e219318b4ac2 tempest-AttachVolumeTestJSON-100281132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:34:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-39643d25-8061-4a2f-911f-e219318b4ac2 tempest-AttachVolumeTestJSON-100281132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:34:27 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-39643d25-8061-4a2f-911f-e219318b4ac2 tempest-AttachVolumeTestJSON-100281132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:34:27 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-39643d25-8061-4a2f-911f-e219318b4ac2 tempest-AttachVolumeTestJSON-100281132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:34:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-39643d25-8061-4a2f-911f-e219318b4ac2 tempest-AttachVolumeTestJSON-100281132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:34:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-39643d25-8061-4a2f-911f-e219318b4ac2 tempest-AttachVolumeTestJSON-100281132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:28 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:34:28 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:34:28 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Nov 06 14:34:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-39643d25-8061-4a2f-911f-e219318b4ac2 tempest-AttachVolumeTestJSON-100281132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.386s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:34:28 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-39643d25-8061-4a2f-911f-e219318b4ac2 tempest-AttachVolumeTestJSON-100281132 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:34:28 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-39643d25-8061-4a2f-911f-e219318b4ac2 tempest-AttachVolumeTestJSON-100281132 None] Deleted volume successfully. Nov 06 14:34:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-39643d25-8061-4a2f-911f-e219318b4ac2 tempest-AttachVolumeTestJSON-100281132 None] Lock "cinder-0415bc6b-6a73-480e-bb0a-c58bd08686b4-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:34:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-cf1cc750-bc91-43f8-b349-eb23ca494296 tempest-AttachVolumeTestJSON-100281132 None] Acquiring lock "cinder-d8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:34:29 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-cf1cc750-bc91-43f8-b349-eb23ca494296 tempest-AttachVolumeTestJSON-100281132 None] Lock "cinder-d8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:34:29 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-cf1cc750-bc91-43f8-b349-eb23ca494296 tempest-AttachVolumeTestJSON-100281132 None] Acquiring lock "cinder-quobyte-d8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:34:29 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-cf1cc750-bc91-43f8-b349-eb23ca494296 tempest-AttachVolumeTestJSON-100281132 None] Lock "cinder-quobyte-d8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a" acquired by "delete_volume" :: waited 0.025s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:34:29 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38bbf65-c5c2-4e58-bd47-5d31b5ac3798]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:34:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cf1cc750-bc91-43f8-b349-eb23ca494296 tempest-AttachVolumeTestJSON-100281132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:29 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a Nov 06 14:34:29 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:34:29 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Nov 06 14:34:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cf1cc750-bc91-43f8-b349-eb23ca494296 tempest-AttachVolumeTestJSON-100281132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a" returned: 0 in 0.376s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:34:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cf1cc750-bc91-43f8-b349-eb23ca494296 tempest-AttachVolumeTestJSON-100281132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:29 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a Nov 06 14:34:29 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:34:29 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Nov 06 14:34:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cf1cc750-bc91-43f8-b349-eb23ca494296 tempest-AttachVolumeTestJSON-100281132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a" returned: 0 in 0.281s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:34:29 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-cf1cc750-bc91-43f8-b349-eb23ca494296 tempest-AttachVolumeTestJSON-100281132 None] Lock "cinder-quobyte-d8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a" released by "delete_volume" :: held 0.718s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:34:29 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-cf1cc750-bc91-43f8-b349-eb23ca494296 tempest-AttachVolumeTestJSON-100281132 None] Created reservations ['64fb2c72-06e8-41f1-a7d6-ff695c3556ad', '22fd073b-de9d-4fce-ae11-9d98a22909a6', '897eb3c3-79d9-41e8-99af-bd821cd317b2', '9b37ab72-889b-4fa9-b3b7-8550aaf902c4'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:34:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-cf1cc750-bc91-43f8-b349-eb23ca494296 tempest-AttachVolumeTestJSON-100281132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:34:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-cf1cc750-bc91-43f8-b349-eb23ca494296 tempest-AttachVolumeTestJSON-100281132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:34:29 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-cf1cc750-bc91-43f8-b349-eb23ca494296 tempest-AttachVolumeTestJSON-100281132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:34:29 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-cf1cc750-bc91-43f8-b349-eb23ca494296 tempest-AttachVolumeTestJSON-100281132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:34:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-cf1cc750-bc91-43f8-b349-eb23ca494296 tempest-AttachVolumeTestJSON-100281132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:34:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cf1cc750-bc91-43f8-b349-eb23ca494296 tempest-AttachVolumeTestJSON-100281132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:29 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:34:29 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:34:30 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Nov 06 14:34:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cf1cc750-bc91-43f8-b349-eb23ca494296 tempest-AttachVolumeTestJSON-100281132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.363s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:34:30 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-cf1cc750-bc91-43f8-b349-eb23ca494296 tempest-AttachVolumeTestJSON-100281132 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:34:30 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-cf1cc750-bc91-43f8-b349-eb23ca494296 tempest-AttachVolumeTestJSON-100281132 None] Deleted volume successfully. Nov 06 14:34:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-cf1cc750-bc91-43f8-b349-eb23ca494296 tempest-AttachVolumeTestJSON-100281132 None] Lock "cinder-d8909fc3-32c0-4d0d-bf4e-d3dfcff72f8a-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:34:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2b1718c-64bc-4b45-8d78-04f0f257c7d4 tempest-AttachVolumeTestJSON-100281132 None] Acquiring lock "cinder-8598ff0a-a2e4-47f8-9fba-79444eadc147-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:34:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2b1718c-64bc-4b45-8d78-04f0f257c7d4 tempest-AttachVolumeTestJSON-100281132 None] Lock "cinder-8598ff0a-a2e4-47f8-9fba-79444eadc147-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:34:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2b1718c-64bc-4b45-8d78-04f0f257c7d4 tempest-AttachVolumeTestJSON-100281132 None] Acquiring lock "cinder-quobyte-8598ff0a-a2e4-47f8-9fba-79444eadc147" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:34:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2b1718c-64bc-4b45-8d78-04f0f257c7d4 tempest-AttachVolumeTestJSON-100281132 None] Lock "cinder-quobyte-8598ff0a-a2e4-47f8-9fba-79444eadc147" acquired by "delete_volume" :: waited 0.028s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:34:31 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb5112f-e19a-4edb-9738-1c1085f69fa9]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:34:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d2b1718c-64bc-4b45-8d78-04f0f257c7d4 tempest-AttachVolumeTestJSON-100281132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8598ff0a-a2e4-47f8-9fba-79444eadc147 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:31 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8598ff0a-a2e4-47f8-9fba-79444eadc147 Nov 06 14:34:31 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:34:31 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Nov 06 14:34:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d2b1718c-64bc-4b45-8d78-04f0f257c7d4 tempest-AttachVolumeTestJSON-100281132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8598ff0a-a2e4-47f8-9fba-79444eadc147" returned: 0 in 0.447s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:34:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d2b1718c-64bc-4b45-8d78-04f0f257c7d4 tempest-AttachVolumeTestJSON-100281132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8598ff0a-a2e4-47f8-9fba-79444eadc147 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:31 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8598ff0a-a2e4-47f8-9fba-79444eadc147 Nov 06 14:34:31 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:34:31 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Nov 06 14:34:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d2b1718c-64bc-4b45-8d78-04f0f257c7d4 tempest-AttachVolumeTestJSON-100281132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8598ff0a-a2e4-47f8-9fba-79444eadc147" returned: 0 in 0.331s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:34:31 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2b1718c-64bc-4b45-8d78-04f0f257c7d4 tempest-AttachVolumeTestJSON-100281132 None] Lock "cinder-quobyte-8598ff0a-a2e4-47f8-9fba-79444eadc147" released by "delete_volume" :: held 0.866s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:34:31 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-d2b1718c-64bc-4b45-8d78-04f0f257c7d4 tempest-AttachVolumeTestJSON-100281132 None] Created reservations ['627eb874-bc76-438d-a2de-80ae1c6f2f65', '6b50001e-0b8b-4c97-8a71-dcee9bbab143', '29a00742-b479-46da-aca6-fa6cd269c7fe', '1ff4cd16-f51a-4201-ab62-08c06ecd3600'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:34:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d2b1718c-64bc-4b45-8d78-04f0f257c7d4 tempest-AttachVolumeTestJSON-100281132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:34:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d2b1718c-64bc-4b45-8d78-04f0f257c7d4 tempest-AttachVolumeTestJSON-100281132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:34:32 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d2b1718c-64bc-4b45-8d78-04f0f257c7d4 tempest-AttachVolumeTestJSON-100281132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:34:32 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d2b1718c-64bc-4b45-8d78-04f0f257c7d4 tempest-AttachVolumeTestJSON-100281132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:34:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d2b1718c-64bc-4b45-8d78-04f0f257c7d4 tempest-AttachVolumeTestJSON-100281132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:34:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d2b1718c-64bc-4b45-8d78-04f0f257c7d4 tempest-AttachVolumeTestJSON-100281132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:32 devstack sudo[96788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:34:32 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:34:32 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root Nov 06 14:34:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d2b1718c-64bc-4b45-8d78-04f0f257c7d4 tempest-AttachVolumeTestJSON-100281132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.431s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:34:32 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-d2b1718c-64bc-4b45-8d78-04f0f257c7d4 tempest-AttachVolumeTestJSON-100281132 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:34:32 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-d2b1718c-64bc-4b45-8d78-04f0f257c7d4 tempest-AttachVolumeTestJSON-100281132 None] Deleted volume successfully. Nov 06 14:34:32 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2b1718c-64bc-4b45-8d78-04f0f257c7d4 tempest-AttachVolumeTestJSON-100281132 None] Lock "cinder-8598ff0a-a2e4-47f8-9fba-79444eadc147-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:34:42 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=20,cinder:UPDATE=27,cinder:INSERT=8,cinder:DELETE=3 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:34:42 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:UPDATE=33,cinder:SELECT=20,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:34:47 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-9b9a8bd9-290c-437f-b788-b385035670e8 tempest-GroupSnapshotsTest-181620141 None] Group tempest-GroupSnapshotsTest-Group-1955912379: creating Nov 06 14:34:47 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-9b9a8bd9-290c-437f-b788-b385035670e8 tempest-GroupSnapshotsTest-181620141 None] Group tempest-GroupSnapshotsTest-Group-1955912379: created successfully Nov 06 14:34:47 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-9b9a8bd9-290c-437f-b788-b385035670e8 tempest-GroupSnapshotsTest-181620141 None] Create group completed successfully. Nov 06 14:34:49 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:34:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Flow 'volume_create_manager' (26fdc5a8-c1a3-4724-ab9b-93219017c377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:34:50 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224ec223-032c-4768-bf11-cb093c780396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:50 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224ec223-032c-4768-bf11-cb093c780396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1304674778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ce3ab07d-6ac5-458c-bd16-4cfddbc33bf1,host='devstack@QuobyteHD#QuobyteHD',id=adfb8657-0a90-4244-a77c-c4318ef3c74c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4d1aebc48e40b5bc58fc6706dc979f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:34:50Z,use_quota=True,user_id='86183259047f45039c3729334eb742f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce92b038-a931-4561-ada2-b6f5843951be),volume_type_id=ce92b038-a931-4561-ada2-b6f5843951be)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:50 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bee9833-a580-4396-ad92-787b1848d4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:50 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bee9833-a580-4396-ad92-787b1848d4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:50 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f3e7bb-b9de-43c7-b775-1c8e4a752d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:50 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f3e7bb-b9de-43c7-b775-1c8e4a752d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adfb8657-0a90-4244-a77c-c4318ef3c74c', 'volume_name': 'volume-adfb8657-0a90-4244-a77c-c4318ef3c74c', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:50 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee77027-2751-4d66-ba95-c1d51e89c5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:50 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee77027-2751-4d66-ba95-c1d51e89c5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:50 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fab3e4d-e1b9-4836-9f43-d3c9a685f4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:50 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Volume adfb8657-0a90-4244-a77c-c4318ef3c74c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adfb8657-0a90-4244-a77c-c4318ef3c74c', 'volume_size': 1} Nov 06 14:34:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:34:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:34:50 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ce3ab07d-6ac5-458c-bd16-4cfddbc33bf1,created_at=2026-11-06T13:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1304674778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ce3ab07d-6ac5-458c-bd16-4cfddbc33bf1,host='devstack@QuobyteHD#QuobyteHD',id=adfb8657-0a90-4244-a77c-c4318ef3c74c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4d1aebc48e40b5bc58fc6706dc979f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:34:50Z,use_quota=True,user_id='86183259047f45039c3729334eb742f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce92b038-a931-4561-ada2-b6f5843951be),volume_type_id=ce92b038-a931-4561-ada2-b6f5843951be)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:34:50 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Creating volume adfb8657-0a90-4244-a77c-c4318ef3c74c {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:34:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:34:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:34:50 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:34:50 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:34:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:34:50 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:34:50 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:34:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:50 devstack sudo[97014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c 1073741824 Nov 06 14:34:50 devstack sudo[97014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:34:51 devstack sudo[97014]: pam_unix(sudo:session): session closed for user root Nov 06 14:34:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c 1073741824" returned: 0 in 1.137s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:34:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:51 devstack sudo[97022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c Nov 06 14:34:51 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:34:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c" returned: 0 in 0.427s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:34:52 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:34:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:34:52 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root Nov 06 14:34:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fab3e4d-e1b9-4836-9f43-d3c9a685f4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adfb8657-0a90-4244-a77c-c4318ef3c74c', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5fec777-6f7e-4890-8770-ee6b0b99e3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:52 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Volume volume-adfb8657-0a90-4244-a77c-c4318ef3c74c (adfb8657-0a90-4244-a77c-c4318ef3c74c): created successfully Nov 06 14:34:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5fec777-6f7e-4890-8770-ee6b0b99e3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Flow 'volume_create_manager' (26fdc5a8-c1a3-4724-ab9b-93219017c377) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:34:52 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-edd15e9f-6f2a-4833-b56c-2fcab7f95738 tempest-GroupSnapshotsTest-181620141 None] Created volume successfully. Nov 06 14:34:53 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-542da36a-cba3-44c3-8133-400baddeac48 tempest-GroupSnapshotsTest-181620141 None] GroupSnapshot ab67508a-329c-46c4-b748-8a97926852ce: creating. Nov 06 14:34:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-542da36a-cba3-44c3-8133-400baddeac48 tempest-GroupSnapshotsTest-181620141 None] Group snapshot ab67508a-329c-46c4-b748-8a97926852ce: creating. {{(pid=86854) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 14:34:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-542da36a-cba3-44c3-8133-400baddeac48 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:34:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-542da36a-cba3-44c3-8133-400baddeac48 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:34:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-542da36a-cba3-44c3-8133-400baddeac48 tempest-GroupSnapshotsTest-181620141 None] Creating offline snapshot 9ed4bb1f-441e-49bf-bc43-cd94a0e2da03 of volume adfb8657-0a90-4244-a77c-c4318ef3c74c {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:34:54 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[241f7eb3-e86c-4507-b509-1dde374bb119]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:34:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-542da36a-cba3-44c3-8133-400baddeac48 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:54 devstack sudo[97124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c Nov 06 14:34:54 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:34:54 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root Nov 06 14:34:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-542da36a-cba3-44c3-8133-400baddeac48 tempest-GroupSnapshotsTest-181620141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c" returned: 0 in 0.536s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:34:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-542da36a-cba3-44c3-8133-400baddeac48 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.9ed4bb1f-441e-49bf-bc43-cd94a0e2da03 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:54 devstack sudo[97130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.9ed4bb1f-441e-49bf-bc43-cd94a0e2da03 1G Nov 06 14:34:54 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:34:55 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root Nov 06 14:34:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-542da36a-cba3-44c3-8133-400baddeac48 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.9ed4bb1f-441e-49bf-bc43-cd94a0e2da03 1G" returned: 0 in 0.764s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:34:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-542da36a-cba3-44c3-8133-400baddeac48 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adfb8657-0a90-4244-a77c-c4318ef3c74c -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.9ed4bb1f-441e-49bf-bc43-cd94a0e2da03 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:55 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adfb8657-0a90-4244-a77c-c4318ef3c74c -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.9ed4bb1f-441e-49bf-bc43-cd94a0e2da03 Nov 06 14:34:55 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:34:55 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Nov 06 14:34:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-542da36a-cba3-44c3-8133-400baddeac48 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adfb8657-0a90-4244-a77c-c4318ef3c74c -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.9ed4bb1f-441e-49bf-bc43-cd94a0e2da03" returned: 0 in 0.454s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:34:55 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-542da36a-cba3-44c3-8133-400baddeac48 tempest-GroupSnapshotsTest-181620141 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.9ed4bb1f-441e-49bf-bc43-cd94a0e2da03 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 14:34:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-542da36a-cba3-44c3-8133-400baddeac48 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.9ed4bb1f-441e-49bf-bc43-cd94a0e2da03 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:55 devstack sudo[97143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.9ed4bb1f-441e-49bf-bc43-cd94a0e2da03 Nov 06 14:34:55 devstack sudo[97143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:34:56 devstack sudo[97143]: pam_unix(sudo:session): session closed for user root Nov 06 14:34:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-542da36a-cba3-44c3-8133-400baddeac48 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.9ed4bb1f-441e-49bf-bc43-cd94a0e2da03" returned: 0 in 0.537s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:34:56 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:34:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Flow 'volume_create_manager' (529d5db0-2bd9-40a3-a0b1-4b282f8ac353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:34:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee0dcb66-595f-4a42-a586-1dcebfcdca05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee0dcb66-595f-4a42-a586-1dcebfcdca05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2031678233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da49ad45-99e2-4709-8d19-48a093d0a49c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca875cdf9e845e0bb79cb66ee6863fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:34:56Z,use_quota=True,user_id='6a1a3517068c4918afc7c88e1e191fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b559eb-1595-4dd2-8dfe-fa146403f47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b559eb-1595-4dd2-8dfe-fa146403f47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a1d00a-ca1c-4e3c-9f24-f45d4d4dabfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a1d00a-ca1c-4e3c-9f24-f45d4d4dabfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da49ad45-99e2-4709-8d19-48a093d0a49c', 'volume_name': 'volume-da49ad45-99e2-4709-8d19-48a093d0a49c', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4af093f-0b3a-4d56-9415-04c59f6a7269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4af093f-0b3a-4d56-9415-04c59f6a7269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf59cad-14b9-4082-afc5-6eda860f25d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:56 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Volume da49ad45-99e2-4709-8d19-48a093d0a49c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da49ad45-99e2-4709-8d19-48a093d0a49c', 'volume_size': 1} Nov 06 14:34:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:34:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-542da36a-cba3-44c3-8133-400baddeac48 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:56 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.info Nov 06 14:34:56 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:34:56 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Nov 06 14:34:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-542da36a-cba3-44c3-8133-400baddeac48 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.info" returned: 0 in 0.331s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:34:57 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-542da36a-cba3-44c3-8133-400baddeac48 tempest-GroupSnapshotsTest-181620141 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 14:34:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-542da36a-cba3-44c3-8133-400baddeac48 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:57 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.info Nov 06 14:34:57 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:34:57 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Nov 06 14:34:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-542da36a-cba3-44c3-8133-400baddeac48 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.info" returned: 0 in 0.496s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:34:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-542da36a-cba3-44c3-8133-400baddeac48 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.509s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:34:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.871s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:34:57 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2031678233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da49ad45-99e2-4709-8d19-48a093d0a49c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca875cdf9e845e0bb79cb66ee6863fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:34:56Z,use_quota=True,user_id='6a1a3517068c4918afc7c88e1e191fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:34:57 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Creating volume da49ad45-99e2-4709-8d19-48a093d0a49c {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:34:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:34:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:34:57 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:34:57 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:34:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:34:57 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:34:57 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:34:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-da49ad45-99e2-4709-8d19-48a093d0a49c 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:57 devstack sudo[97155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-da49ad45-99e2-4709-8d19-48a093d0a49c 1073741824 Nov 06 14:34:57 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:34:57 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-542da36a-cba3-44c3-8133-400baddeac48 tempest-GroupSnapshotsTest-181620141 None] group_snapshot ab67508a-329c-46c4-b748-8a97926852ce: created successfully Nov 06 14:34:58 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root Nov 06 14:34:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-da49ad45-99e2-4709-8d19-48a093d0a49c 1073741824" returned: 0 in 0.643s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:34:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-da49ad45-99e2-4709-8d19-48a093d0a49c {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:58 devstack sudo[97162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-da49ad45-99e2-4709-8d19-48a093d0a49c Nov 06 14:34:58 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:34:58 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root Nov 06 14:34:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-da49ad45-99e2-4709-8d19-48a093d0a49c" returned: 0 in 0.428s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:34:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:34:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:34:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf59cad-14b9-4082-afc5-6eda860f25d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da49ad45-99e2-4709-8d19-48a093d0a49c', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7a11642-cfe9-4ee0-b1fc-6f3d6469cbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:34:58 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Volume volume-da49ad45-99e2-4709-8d19-48a093d0a49c (da49ad45-99e2-4709-8d19-48a093d0a49c): created successfully Nov 06 14:34:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7a11642-cfe9-4ee0-b1fc-6f3d6469cbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:34:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Flow 'volume_create_manager' (529d5db0-2bd9-40a3-a0b1-4b282f8ac353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:34:58 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-16b1b2ab-7c8b-460e-a407-82d12f2e01cf tempest-TestMinimumBasicScenario-2070269532 None] Created volume successfully. Nov 06 14:34:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:34:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:34:59 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "cinder-quobyte-9ed4bb1f-441e-49bf-bc43-cd94a0e2da03-020786ff-81a3-4021-871f-033342485414" by "_create_volume_from_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:34:59 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-9ed4bb1f-441e-49bf-bc43-cd94a0e2da03-020786ff-81a3-4021-871f-033342485414" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:34:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Creating volume 020786ff-81a3-4021-871f-033342485414 from snapshot 9ed4bb1f-441e-49bf-bc43-cd94a0e2da03 {{(pid=86854) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 14:34:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:34:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:34:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:34:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:34:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:34:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:34:59 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "cinder-quobyte-020786ff-81a3-4021-871f-033342485414" by "_copy_volume_from_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:34:59 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-020786ff-81a3-4021-871f-033342485414" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:34:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] snapshot: 9ed4bb1f-441e-49bf-bc43-cd94a0e2da03, volume: 020786ff-81a3-4021-871f-033342485414, {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 14:34:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:34:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:34:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:34:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:34:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:34:59 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[d863e44d-5336-4fb8-8a07-60dd164b062a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:34:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.9ed4bb1f-441e-49bf-bc43-cd94a0e2da03 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:34:59 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.9ed4bb1f-441e-49bf-bc43-cd94a0e2da03 Nov 06 14:34:59 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:00 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.9ed4bb1f-441e-49bf-bc43-cd94a0e2da03" returned: 0 in 0.627s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adfb8657-0a90-4244-a77c-c4318ef3c74c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:35:00 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ca9590-7ae7-4743-808e-bb1441e67bfa]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:35:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:00 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c Nov 06 14:35:00 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:00 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c" returned: 0 in 0.772s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 14:35:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Creating direct copy from snapshot {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 14:35:00 devstack cinder-volume[86854]: DEBUG cinder.utils [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Path /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-020786ff-81a3-4021-871f-033342485414 not found in is_blk_device check {{(pid=86854) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 14:35:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-020786ff-81a3-4021-871f-033342485414 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:00 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-020786ff-81a3-4021-871f-033342485414 Nov 06 14:35:00 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-7eb7b748-30c2-4af7-9302-48e6ea23c8cd req-f6057b58-38df-4f24-8755-1a8b0dedf72c tempest-TestMinimumBasicScenario-2070269532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-bc091b18-d0d3-4904-90f2-13385997ebeb req-870fe689-dac1-42b8-93cf-0dbf5575078f tempest-TestServerVolumeAttachmentScenario-346953665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:10 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-020786ff-81a3-4021-871f-033342485414" returned: 0 in 9.394s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:10 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Image conversion details: src /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c, size 1024.00 MB, duration 9.39 sec, destination /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-020786ff-81a3-4021-871f-033342485414 {{(pid=86854) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 14:35:10 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Converted 1024.00 MB image at 109.00 MB/s Nov 06 14:35:10 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-020786ff-81a3-4021-871f-033342485414 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 14:35:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-020786ff-81a3-4021-871f-033342485414 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:10 devstack sudo[97314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-020786ff-81a3-4021-871f-033342485414 Nov 06 14:35:10 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:10 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-020786ff-81a3-4021-871f-033342485414" returned: 0 in 0.237s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:10 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-020786ff-81a3-4021-871f-033342485414" released by "_copy_volume_from_snapshot" :: held 11.160s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:35:10 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-9ed4bb1f-441e-49bf-bc43-cd94a0e2da03-020786ff-81a3-4021-871f-033342485414" released by "_create_volume_from_snapshot" :: held 11.236s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:35:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.263s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-7eb7b748-30c2-4af7-9302-48e6ea23c8cd req-f6057b58-38df-4f24-8755-1a8b0dedf72c tempest-TestMinimumBasicScenario-2070269532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.367s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-7eb7b748-30c2-4af7-9302-48e6ea23c8cd req-f6057b58-38df-4f24-8755-1a8b0dedf72c tempest-TestMinimumBasicScenario-2070269532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-bc091b18-d0d3-4904-90f2-13385997ebeb req-870fe689-dac1-42b8-93cf-0dbf5575078f tempest-TestServerVolumeAttachmentScenario-346953665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.821s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-bc091b18-d0d3-4904-90f2-13385997ebeb req-870fe689-dac1-42b8-93cf-0dbf5575078f tempest-TestServerVolumeAttachmentScenario-346953665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-7eb7b748-30c2-4af7-9302-48e6ea23c8cd req-f6057b58-38df-4f24-8755-1a8b0dedf72c tempest-TestMinimumBasicScenario-2070269532 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e', 'name': 'volume-da49ad45-99e2-4709-8d19-48a093d0a49c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4a7f489f-b06b-46f0-bbd6-9a639e491b1b', 'enforce_multipath': True} {{(pid=86854) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 14:35:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-bc091b18-d0d3-4904-90f2-13385997ebeb req-870fe689-dac1-42b8-93cf-0dbf5575078f tempest-TestServerVolumeAttachmentScenario-346953665 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e', 'name': 'volume-aeb498a9-9cde-439d-9998-335568ac7aef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe8f971b-b0c3-48b8-9ab4-f8e3219f6eae', 'enforce_multipath': True} {{(pid=86854) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 14:35:10 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-7fa07298-db33-4d8b-97ff-1a26642d1c38 tempest-GroupSnapshotsTest-181620141 None] Create group from source-snapshot-ab67508a-329c-46c4-b748-8a97926852ce completed successfully. Nov 06 14:35:10 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-7eb7b748-30c2-4af7-9302-48e6ea23c8cd req-f6057b58-38df-4f24-8755-1a8b0dedf72c tempest-TestMinimumBasicScenario-2070269532 None] attachment_update completed successfully. Nov 06 14:35:10 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-bc091b18-d0d3-4904-90f2-13385997ebeb req-870fe689-dac1-42b8-93cf-0dbf5575078f tempest-TestServerVolumeAttachmentScenario-346953665 None] attachment_update completed successfully. Nov 06 14:35:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3276d226-912d-4e59-9aa7-8e8f3c555d48 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "cinder-quobyte-020786ff-81a3-4021-871f-033342485414" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:35:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3276d226-912d-4e59-9aa7-8e8f3c555d48 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-020786ff-81a3-4021-871f-033342485414" acquired by "delete_volume" :: waited 0.021s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:35:11 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[7307703b-63da-422a-b01a-ba5ca9ab16e3]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:35:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3276d226-912d-4e59-9aa7-8e8f3c555d48 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-020786ff-81a3-4021-871f-033342485414 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:11 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-020786ff-81a3-4021-871f-033342485414 Nov 06 14:35:11 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:11 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3276d226-912d-4e59-9aa7-8e8f3c555d48 tempest-GroupSnapshotsTest-181620141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-020786ff-81a3-4021-871f-033342485414" returned: 0 in 0.476s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3276d226-912d-4e59-9aa7-8e8f3c555d48 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-020786ff-81a3-4021-871f-033342485414 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:12 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-020786ff-81a3-4021-871f-033342485414 Nov 06 14:35:12 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:12 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3276d226-912d-4e59-9aa7-8e8f3c555d48 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-020786ff-81a3-4021-871f-033342485414" returned: 0 in 0.311s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:12 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3276d226-912d-4e59-9aa7-8e8f3c555d48 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-020786ff-81a3-4021-871f-033342485414" released by "delete_volume" :: held 0.890s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:35:12 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-3276d226-912d-4e59-9aa7-8e8f3c555d48 tempest-GroupSnapshotsTest-181620141 None] Created reservations ['b4361dcd-46a2-46e8-83aa-53ec1c240fc0'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:35:12 devstack cinder-volume[86854]: WARNING cinder.quota [None req-3276d226-912d-4e59-9aa7-8e8f3c555d48 tempest-GroupSnapshotsTest-181620141 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-602207253 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-602207253, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:35:12 devstack cinder-volume[86854]: WARNING cinder.quota [None req-3276d226-912d-4e59-9aa7-8e8f3c555d48 tempest-GroupSnapshotsTest-181620141 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-602207253 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-602207253, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:35:12 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-3276d226-912d-4e59-9aa7-8e8f3c555d48 tempest-GroupSnapshotsTest-181620141 None] Created reservations ['61bc5785-29fc-44cb-9fd0-d17c76edcbc1', '513512fa-8000-4dcc-982e-6cc8d97947f5', 'dfa74790-6565-499f-938e-e451e189d491', '6e677dca-1ce7-4505-838c-2c5f7e5f4229'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:35:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3276d226-912d-4e59-9aa7-8e8f3c555d48 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3276d226-912d-4e59-9aa7-8e8f3c555d48 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:12 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3276d226-912d-4e59-9aa7-8e8f3c555d48 tempest-GroupSnapshotsTest-181620141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:35:12 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3276d226-912d-4e59-9aa7-8e8f3c555d48 tempest-GroupSnapshotsTest-181620141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:35:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3276d226-912d-4e59-9aa7-8e8f3c555d48 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3276d226-912d-4e59-9aa7-8e8f3c555d48 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:12 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:35:12 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:13 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3276d226-912d-4e59-9aa7-8e8f3c555d48 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.412s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:13 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-3276d226-912d-4e59-9aa7-8e8f3c555d48 tempest-GroupSnapshotsTest-181620141 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:35:13 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-3276d226-912d-4e59-9aa7-8e8f3c555d48 tempest-GroupSnapshotsTest-181620141 None] Delete group completed successfully. Nov 06 14:35:14 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-51cf7ab9-ab10-42e4-9736-b26618cde5d0 tempest-GroupSnapshotsTest-181620141 None] group_snapshot ab67508a-329c-46c4-b748-8a97926852ce: deleting Nov 06 14:35:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-51cf7ab9-ab10-42e4-9736-b26618cde5d0 tempest-GroupSnapshotsTest-181620141 None] group_snapshot ab67508a-329c-46c4-b748-8a97926852ce: deleting {{(pid=86854) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 14:35:14 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-51cf7ab9-ab10-42e4-9736-b26618cde5d0 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "cinder-quobyte-adfb8657-0a90-4244-a77c-c4318ef3c74c" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:35:14 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-51cf7ab9-ab10-42e4-9736-b26618cde5d0 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-adfb8657-0a90-4244-a77c-c4318ef3c74c" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:35:14 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-51cf7ab9-ab10-42e4-9736-b26618cde5d0 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "cinder-quobyte-9ed4bb1f-441e-49bf-bc43-cd94a0e2da03" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:35:14 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-51cf7ab9-ab10-42e4-9736-b26618cde5d0 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-9ed4bb1f-441e-49bf-bc43-cd94a0e2da03" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:35:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-51cf7ab9-ab10-42e4-9736-b26618cde5d0 tempest-GroupSnapshotsTest-181620141 None] Deleting offline snapshot 9ed4bb1f-441e-49bf-bc43-cd94a0e2da03 of volume adfb8657-0a90-4244-a77c-c4318ef3c74c {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:35:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-51cf7ab9-ab10-42e4-9736-b26618cde5d0 tempest-GroupSnapshotsTest-181620141 None] snapshot_file for this snap is: volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.9ed4bb1f-441e-49bf-bc43-cd94a0e2da03 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:35:14 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7c6ce3-a601-40de-9ba8-37e93474cf8d]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:35:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-51cf7ab9-ab10-42e4-9736-b26618cde5d0 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.9ed4bb1f-441e-49bf-bc43-cd94a0e2da03 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:14 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.9ed4bb1f-441e-49bf-bc43-cd94a0e2da03 Nov 06 14:35:14 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:14 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-51cf7ab9-ab10-42e4-9736-b26618cde5d0 tempest-GroupSnapshotsTest-181620141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.9ed4bb1f-441e-49bf-bc43-cd94a0e2da03" returned: 0 in 0.517s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-51cf7ab9-ab10-42e4-9736-b26618cde5d0 tempest-GroupSnapshotsTest-181620141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adfb8657-0a90-4244-a77c-c4318ef3c74c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:35:14 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cafdb9-cd7c-46c0-8ccd-a501abfafe21]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:35:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-51cf7ab9-ab10-42e4-9736-b26618cde5d0 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:14 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c Nov 06 14:35:14 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:15 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-51cf7ab9-ab10-42e4-9736-b26618cde5d0 tempest-GroupSnapshotsTest-181620141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c" returned: 0 in 0.781s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-51cf7ab9-ab10-42e4-9736-b26618cde5d0 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.9ed4bb1f-441e-49bf-bc43-cd94a0e2da03 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:15 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.9ed4bb1f-441e-49bf-bc43-cd94a0e2da03 Nov 06 14:35:15 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-4d54da78-3ac6-4d1a-b58a-1b3c5789ceff req-e12a13fa-8d3c-4105-a43a-dbbe3fa53bd3 tempest-TestServerVolumeAttachmentScenario-346953665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-4d54da78-3ac6-4d1a-b58a-1b3c5789ceff req-e12a13fa-8d3c-4105-a43a-dbbe3fa53bd3 tempest-TestServerVolumeAttachmentScenario-346953665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-4d54da78-3ac6-4d1a-b58a-1b3c5789ceff req-e12a13fa-8d3c-4105-a43a-dbbe3fa53bd3 tempest-TestServerVolumeAttachmentScenario-346953665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:16 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-51cf7ab9-ab10-42e4-9736-b26618cde5d0 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.9ed4bb1f-441e-49bf-bc43-cd94a0e2da03" returned: 0 in 0.566s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-51cf7ab9-ab10-42e4-9736-b26618cde5d0 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.9ed4bb1f-441e-49bf-bc43-cd94a0e2da03 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-4d54da78-3ac6-4d1a-b58a-1b3c5789ceff req-e12a13fa-8d3c-4105-a43a-dbbe3fa53bd3 tempest-TestServerVolumeAttachmentScenario-346953665 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e', 'name': 'volume-16cd4667-5861-44a0-be4f-8f3685e531bb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0a318a7-4628-45fc-889a-d8860c90bc8c', 'enforce_multipath': True} {{(pid=86854) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 14:35:16 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.9ed4bb1f-441e-49bf-bc43-cd94a0e2da03 Nov 06 14:35:16 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:16 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-4d54da78-3ac6-4d1a-b58a-1b3c5789ceff req-e12a13fa-8d3c-4105-a43a-dbbe3fa53bd3 tempest-TestServerVolumeAttachmentScenario-346953665 None] attachment_update completed successfully. Nov 06 14:35:16 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-51cf7ab9-ab10-42e4-9736-b26618cde5d0 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c.9ed4bb1f-441e-49bf-bc43-cd94a0e2da03" returned: 0 in 0.454s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:16 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-51cf7ab9-ab10-42e4-9736-b26618cde5d0 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-9ed4bb1f-441e-49bf-bc43-cd94a0e2da03" released by "_delete_snapshot" :: held 2.512s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:35:16 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-51cf7ab9-ab10-42e4-9736-b26618cde5d0 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-adfb8657-0a90-4244-a77c-c4318ef3c74c" released by "delete_snapshot" :: held 2.572s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:35:16 devstack cinder-volume[86854]: WARNING cinder.quota [None req-51cf7ab9-ab10-42e4-9736-b26618cde5d0 tempest-GroupSnapshotsTest-181620141 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-602207253 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-602207253, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:35:16 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-51cf7ab9-ab10-42e4-9736-b26618cde5d0 tempest-GroupSnapshotsTest-181620141 None] Created reservations ['d65cee8d-1ce7-44c2-bfa5-f7e64b6b4d59', 'f4fec917-c4d3-4d48-9407-0a8490aadc64', 'e6f683fb-d65d-48b5-82b0-71fd0c360ffd', '064ea993-fd10-4666-aeac-6fab8bad46d6'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:35:16 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-51cf7ab9-ab10-42e4-9736-b26618cde5d0 tempest-GroupSnapshotsTest-181620141 None] group_snapshot ab67508a-329c-46c4-b748-8a97926852ce: deleted successfully Nov 06 14:35:17 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7906198d-3cf2-4d6e-9865-db8e3669aa82 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "cinder-quobyte-adfb8657-0a90-4244-a77c-c4318ef3c74c" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:35:17 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7906198d-3cf2-4d6e-9865-db8e3669aa82 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-adfb8657-0a90-4244-a77c-c4318ef3c74c" acquired by "delete_volume" :: waited 0.024s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:35:17 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[480d51a2-38ae-45af-8711-2551aaa0cabc]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:35:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7906198d-3cf2-4d6e-9865-db8e3669aa82 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:18 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c Nov 06 14:35:18 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:18 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7906198d-3cf2-4d6e-9865-db8e3669aa82 tempest-GroupSnapshotsTest-181620141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c" returned: 0 in 0.553s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7906198d-3cf2-4d6e-9865-db8e3669aa82 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:18 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c Nov 06 14:35:18 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:18 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7906198d-3cf2-4d6e-9865-db8e3669aa82 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-adfb8657-0a90-4244-a77c-c4318ef3c74c" returned: 0 in 0.274s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7906198d-3cf2-4d6e-9865-db8e3669aa82 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-adfb8657-0a90-4244-a77c-c4318ef3c74c" released by "delete_volume" :: held 0.941s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:35:18 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-7906198d-3cf2-4d6e-9865-db8e3669aa82 tempest-GroupSnapshotsTest-181620141 None] Created reservations ['21962b97-65b5-441a-8abb-f759ec125a5c'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:35:18 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-fda299c6-e26b-4c90-b5b7-b8ca077c159b req-91086ef0-2e96-4420-8dde-05380f4242f4 tempest-TestServerVolumeAttachmentScenario-346953665 None] Terminate volume connection completed successfully. Nov 06 14:35:18 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-fda299c6-e26b-4c90-b5b7-b8ca077c159b req-91086ef0-2e96-4420-8dde-05380f4242f4 tempest-TestServerVolumeAttachmentScenario-346953665 None] Deleting attachment b0a318a7-4628-45fc-889a-d8860c90bc8c. {{(pid=86854) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 14:35:18 devstack cinder-volume[86854]: WARNING cinder.db.api [None req-7906198d-3cf2-4d6e-9865-db8e3669aa82 tempest-GroupSnapshotsTest-181620141 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-602207253'] Nov 06 14:35:18 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-7906198d-3cf2-4d6e-9865-db8e3669aa82 tempest-GroupSnapshotsTest-181620141 None] Created reservations ['3d757d56-7bf9-4f41-b06e-b7fb79c300d2', '49f1d03c-d5f9-422d-9e83-2faa9d71558e', '15803f8d-d17b-43d0-adc5-0d16c1d76838', '69e182c7-c144-4144-b91e-dc71c24b9fb6'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:35:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7906198d-3cf2-4d6e-9865-db8e3669aa82 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7906198d-3cf2-4d6e-9865-db8e3669aa82 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7906198d-3cf2-4d6e-9865-db8e3669aa82 tempest-GroupSnapshotsTest-181620141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:35:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7906198d-3cf2-4d6e-9865-db8e3669aa82 tempest-GroupSnapshotsTest-181620141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:35:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7906198d-3cf2-4d6e-9865-db8e3669aa82 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7906198d-3cf2-4d6e-9865-db8e3669aa82 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:19 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:35:19 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:19 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7906198d-3cf2-4d6e-9865-db8e3669aa82 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.422s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:19 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-7906198d-3cf2-4d6e-9865-db8e3669aa82 tempest-GroupSnapshotsTest-181620141 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:35:19 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-7906198d-3cf2-4d6e-9865-db8e3669aa82 tempest-GroupSnapshotsTest-181620141 None] Delete group completed successfully. Nov 06 14:35:19 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-bb29b367-dc4e-4aed-a405-4357bf09658d tempest-GroupSnapshotsTest-181620141 None] Group tempest-GroupSnapshotsTest-Group-1548130082: creating Nov 06 14:35:19 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-bb29b367-dc4e-4aed-a405-4357bf09658d tempest-GroupSnapshotsTest-181620141 None] Group tempest-GroupSnapshotsTest-Group-1548130082: created successfully Nov 06 14:35:19 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-bb29b367-dc4e-4aed-a405-4357bf09658d tempest-GroupSnapshotsTest-181620141 None] Create group completed successfully. Nov 06 14:35:20 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-f0571567-7e16-494c-82a5-e5ee1e98768f req-dd216e40-8977-448b-80a0-582d8df4e535 tempest-TestServerVolumeAttachmentScenario-346953665 None] Terminate volume connection completed successfully. Nov 06 14:35:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-f0571567-7e16-494c-82a5-e5ee1e98768f req-dd216e40-8977-448b-80a0-582d8df4e535 tempest-TestServerVolumeAttachmentScenario-346953665 None] Deleting attachment fe8f971b-b0c3-48b8-9ab4-f8e3219f6eae. {{(pid=86854) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 14:35:20 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:35:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Flow 'volume_create_manager' (2d208059-ff4e-4b8d-8464-e29dd0d6900d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:35:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491e5558-6396-4864-ae35-b67511a8010f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491e5558-6396-4864-ae35-b67511a8010f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1690449328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2be36def-c369-4b1f-88ea-6f4793f4fcb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9af60c62844347dfbe5727070c2111cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:35:21Z,use_quota=True,user_id='2ef393ee75d1408caceda02b6b9e8f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94986263-8e88-4d0c-9cf6-08867bd01097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94986263-8e88-4d0c-9cf6-08867bd01097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5467ccbf-da10-41ee-a3ba-cb5785396dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5467ccbf-da10-41ee-a3ba-cb5785396dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2be36def-c369-4b1f-88ea-6f4793f4fcb5', 'volume_name': 'volume-2be36def-c369-4b1f-88ea-6f4793f4fcb5', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc9d9eb9-8d3f-4e1e-b3de-05ff93023b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc9d9eb9-8d3f-4e1e-b3de-05ff93023b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f3e72f-09ac-47d7-82a1-98105d13de23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:20 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Volume 2be36def-c369-4b1f-88ea-6f4793f4fcb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2be36def-c369-4b1f-88ea-6f4793f4fcb5', 'volume_size': 1} Nov 06 14:35:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1690449328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2be36def-c369-4b1f-88ea-6f4793f4fcb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9af60c62844347dfbe5727070c2111cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:35:21Z,use_quota=True,user_id='2ef393ee75d1408caceda02b6b9e8f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:35:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Creating volume 2be36def-c369-4b1f-88ea-6f4793f4fcb5 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:35:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:35:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:35:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:35:20 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:35:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2be36def-c369-4b1f-88ea-6f4793f4fcb5 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:20 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2be36def-c369-4b1f-88ea-6f4793f4fcb5 1073741824 Nov 06 14:35:20 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:21 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2be36def-c369-4b1f-88ea-6f4793f4fcb5 1073741824" returned: 0 in 0.624s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Flow 'volume_create_manager' (3e2ae05b-5a97-4e88-9637-935c85afbfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc951547-a62b-4662-8501-d4dce8ba570c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2be36def-c369-4b1f-88ea-6f4793f4fcb5 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:21 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2be36def-c369-4b1f-88ea-6f4793f4fcb5 Nov 06 14:35:21 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc951547-a62b-4662-8501-d4dce8ba570c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1919600108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=45e62c73-17a5-4f2e-89d2-8265a81de287,host='devstack@QuobyteHD#QuobyteHD',id=f901cf84-1a8f-4f96-a9af-9dc85624d317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4d1aebc48e40b5bc58fc6706dc979f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:35:21Z,use_quota=True,user_id='86183259047f45039c3729334eb742f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70aac21c-ecf0-4577-ac4f-c7f9c4b67869),volume_type_id=70aac21c-ecf0-4577-ac4f-c7f9c4b67869)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7965fbf6-e45f-4b90-a362-5d7967719613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7965fbf6-e45f-4b90-a362-5d7967719613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505226a8-2dae-407f-9ba1-fc7ba94128b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505226a8-2dae-407f-9ba1-fc7ba94128b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f901cf84-1a8f-4f96-a9af-9dc85624d317', 'volume_name': 'volume-f901cf84-1a8f-4f96-a9af-9dc85624d317', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54dbaf6b-9bf6-4242-a10f-fe7d065e9c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54dbaf6b-9bf6-4242-a10f-fe7d065e9c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4a946d-96eb-43c0-b193-d80cd65f52bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:21 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Volume f901cf84-1a8f-4f96-a9af-9dc85624d317: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f901cf84-1a8f-4f96-a9af-9dc85624d317', 'volume_size': 1} Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:21 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2be36def-c369-4b1f-88ea-6f4793f4fcb5" returned: 0 in 0.335s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.244s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=45e62c73-17a5-4f2e-89d2-8265a81de287,created_at=2026-11-06T13:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1919600108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=45e62c73-17a5-4f2e-89d2-8265a81de287,host='devstack@QuobyteHD#QuobyteHD',id=f901cf84-1a8f-4f96-a9af-9dc85624d317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4d1aebc48e40b5bc58fc6706dc979f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:35:21Z,use_quota=True,user_id='86183259047f45039c3729334eb742f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70aac21c-ecf0-4577-ac4f-c7f9c4b67869),volume_type_id=70aac21c-ecf0-4577-ac4f-c7f9c4b67869)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Creating volume f901cf84-1a8f-4f96-a9af-9dc85624d317 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:35:21 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f3e72f-09ac-47d7-82a1-98105d13de23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2be36def-c369-4b1f-88ea-6f4793f4fcb5', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc16fe9b-e2f4-41a7-950c-86cbe94b8aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:21 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317 1073741824 Nov 06 14:35:21 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:21 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Volume volume-2be36def-c369-4b1f-88ea-6f4793f4fcb5 (2be36def-c369-4b1f-88ea-6f4793f4fcb5): created successfully Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc16fe9b-e2f4-41a7-950c-86cbe94b8aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Flow 'volume_create_manager' (2d208059-ff4e-4b8d-8464-e29dd0d6900d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:35:21 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-8930d558-8ce8-4b04-954a-2031f6635750 tempest-AttachVolumeNegativeTest-1303646863 None] Created volume successfully. Nov 06 14:35:22 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317 1073741824" returned: 0 in 0.661s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:22 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317 Nov 06 14:35:22 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:22 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317" returned: 0 in 0.373s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:22 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:35:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:22 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4a946d-96eb-43c0-b193-d80cd65f52bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f901cf84-1a8f-4f96-a9af-9dc85624d317', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:22 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a02a6ca-2781-4643-a611-ae6f2a476c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:23 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Volume volume-f901cf84-1a8f-4f96-a9af-9dc85624d317 (f901cf84-1a8f-4f96-a9af-9dc85624d317): created successfully Nov 06 14:35:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a02a6ca-2781-4643-a611-ae6f2a476c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Flow 'volume_create_manager' (3e2ae05b-5a97-4e88-9637-935c85afbfcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:35:23 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-ed2cdd08-b2cb-444c-9a20-24022c8d8344 tempest-GroupSnapshotsTest-181620141 None] Created volume successfully. Nov 06 14:35:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:35:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:35:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:35:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:23 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:35:23 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:23 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.464s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:23 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:35:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager._thread_info {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:35:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread count: 28 {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 14:35:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread info: [<_MainThread(MainThread, started 130306900594816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 14:35:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-33772d4a-8e10-4deb-81ce-83850a455f07 req-cd3bfe4c-8afc-49ec-8f0f-4b7ae8a4e7f7 tempest-AttachVolumeNegativeTest-1303646863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-33772d4a-8e10-4deb-81ce-83850a455f07 req-cd3bfe4c-8afc-49ec-8f0f-4b7ae8a4e7f7 tempest-AttachVolumeNegativeTest-1303646863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-33772d4a-8e10-4deb-81ce-83850a455f07 req-cd3bfe4c-8afc-49ec-8f0f-4b7ae8a4e7f7 tempest-AttachVolumeNegativeTest-1303646863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-33772d4a-8e10-4deb-81ce-83850a455f07 req-cd3bfe4c-8afc-49ec-8f0f-4b7ae8a4e7f7 tempest-AttachVolumeNegativeTest-1303646863 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e', 'name': 'volume-2be36def-c369-4b1f-88ea-6f4793f4fcb5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9799eff7-39e4-4614-af6d-6accd531f5c7', 'enforce_multipath': True} {{(pid=86854) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 14:35:23 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-33772d4a-8e10-4deb-81ce-83850a455f07 req-cd3bfe4c-8afc-49ec-8f0f-4b7ae8a4e7f7 tempest-AttachVolumeNegativeTest-1303646863 None] attachment_update completed successfully. Nov 06 14:35:24 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:35:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Flow 'volume_create_manager' (edc1484e-8e42-4c55-8f46-bf858c255ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:35:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d364f4-f548-4d8b-8bc5-0283fb38dd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d364f4-f548-4d8b-8bc5-0283fb38dd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-682624246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=45e62c73-17a5-4f2e-89d2-8265a81de287,host='devstack@QuobyteHD#QuobyteHD',id=42e6d37c-4a42-453f-90fa-0cbfadf9279f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4d1aebc48e40b5bc58fc6706dc979f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:35:25Z,use_quota=True,user_id='86183259047f45039c3729334eb742f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70aac21c-ecf0-4577-ac4f-c7f9c4b67869),volume_type_id=70aac21c-ecf0-4577-ac4f-c7f9c4b67869)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (318eba11-0197-4ae2-81de-4dc3d7b6e23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (318eba11-0197-4ae2-81de-4dc3d7b6e23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d195def-c88e-47b2-a9eb-607b19534ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d195def-c88e-47b2-a9eb-607b19534ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42e6d37c-4a42-453f-90fa-0cbfadf9279f', 'volume_name': 'volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc2672f-63a8-408c-a8db-889a2f124fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc2672f-63a8-408c-a8db-889a2f124fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792415a3-df47-4b0f-93f4-0d613e7faf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:24 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Volume 42e6d37c-4a42-453f-90fa-0cbfadf9279f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f', 'volume_size': 1} Nov 06 14:35:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=45e62c73-17a5-4f2e-89d2-8265a81de287,created_at=2026-11-06T13:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-682624246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=45e62c73-17a5-4f2e-89d2-8265a81de287,host='devstack@QuobyteHD#QuobyteHD',id=42e6d37c-4a42-453f-90fa-0cbfadf9279f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4d1aebc48e40b5bc58fc6706dc979f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:35:25Z,use_quota=True,user_id='86183259047f45039c3729334eb742f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70aac21c-ecf0-4577-ac4f-c7f9c4b67869),volume_type_id=70aac21c-ecf0-4577-ac4f-c7f9c4b67869)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:35:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Creating volume 42e6d37c-4a42-453f-90fa-0cbfadf9279f {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:35:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:35:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:35:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:35:24 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:35:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:24 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f 1073741824 Nov 06 14:35:24 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:25 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f 1073741824" returned: 0 in 0.558s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:25 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f Nov 06 14:35:25 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:25 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-7aa5802b-fec4-4827-96ea-d390b061e3f7 req-0c774811-493d-488e-80a4-7af6739cbc2e tempest-AttachVolumeNegativeTest-1303646863 None] Terminate volume connection completed successfully. Nov 06 14:35:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-7aa5802b-fec4-4827-96ea-d390b061e3f7 req-0c774811-493d-488e-80a4-7af6739cbc2e tempest-AttachVolumeNegativeTest-1303646863 None] Deleting attachment 9799eff7-39e4-4614-af6d-6accd531f5c7. {{(pid=86854) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 14:35:25 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f" returned: 0 in 0.282s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:35:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792415a3-df47-4b0f-93f4-0d613e7faf5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad72d5f-802a-4c6b-93d0-9ffbe7f154ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:25 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d9e4f5f7-95c6-4d71-b726-16882c4a77f2 tempest-TestServerVolumeAttachmentScenario-346953665 None] Acquiring lock "cinder-16cd4667-5861-44a0-be4f-8f3685e531bb-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:35:25 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Volume volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f (42e6d37c-4a42-453f-90fa-0cbfadf9279f): created successfully Nov 06 14:35:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad72d5f-802a-4c6b-93d0-9ffbe7f154ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Flow 'volume_create_manager' (edc1484e-8e42-4c55-8f46-bf858c255ac6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:35:25 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d9e4f5f7-95c6-4d71-b726-16882c4a77f2 tempest-TestServerVolumeAttachmentScenario-346953665 None] Lock "cinder-16cd4667-5861-44a0-be4f-8f3685e531bb-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:35:25 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-312612cd-4fd3-4b92-a8d9-ab7775601328 tempest-GroupSnapshotsTest-181620141 None] Created volume successfully. Nov 06 14:35:25 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d9e4f5f7-95c6-4d71-b726-16882c4a77f2 tempest-TestServerVolumeAttachmentScenario-346953665 None] Acquiring lock "cinder-quobyte-16cd4667-5861-44a0-be4f-8f3685e531bb" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:35:25 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d9e4f5f7-95c6-4d71-b726-16882c4a77f2 tempest-TestServerVolumeAttachmentScenario-346953665 None] Lock "cinder-quobyte-16cd4667-5861-44a0-be4f-8f3685e531bb" acquired by "delete_volume" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:35:25 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b604e3-7225-4445-b5d9-6694af3b6279]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:35:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d9e4f5f7-95c6-4d71-b726-16882c4a77f2 tempest-TestServerVolumeAttachmentScenario-346953665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-16cd4667-5861-44a0-be4f-8f3685e531bb {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:26 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-16cd4667-5861-44a0-be4f-8f3685e531bb Nov 06 14:35:26 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:26 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-09b997b0-1224-4efc-b6c8-6581051d2e8c tempest-GroupSnapshotsTest-181620141 None] Update group completed successfully. Nov 06 14:35:26 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d9e4f5f7-95c6-4d71-b726-16882c4a77f2 tempest-TestServerVolumeAttachmentScenario-346953665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-16cd4667-5861-44a0-be4f-8f3685e531bb" returned: 0 in 0.396s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d9e4f5f7-95c6-4d71-b726-16882c4a77f2 tempest-TestServerVolumeAttachmentScenario-346953665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-16cd4667-5861-44a0-be4f-8f3685e531bb {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:26 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-16cd4667-5861-44a0-be4f-8f3685e531bb Nov 06 14:35:26 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:26 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d9e4f5f7-95c6-4d71-b726-16882c4a77f2 tempest-TestServerVolumeAttachmentScenario-346953665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-16cd4667-5861-44a0-be4f-8f3685e531bb" returned: 0 in 0.284s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:26 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d9e4f5f7-95c6-4d71-b726-16882c4a77f2 tempest-TestServerVolumeAttachmentScenario-346953665 None] Lock "cinder-quobyte-16cd4667-5861-44a0-be4f-8f3685e531bb" released by "delete_volume" :: held 0.734s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:35:26 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-d9e4f5f7-95c6-4d71-b726-16882c4a77f2 tempest-TestServerVolumeAttachmentScenario-346953665 None] Created reservations ['8cf47bc0-3309-428d-b363-637c75bb2e0b', '7f0c1ebb-bfbc-45e5-828e-3545d3007e92', '0fa1482c-8ede-4d28-9d42-d9db4f8307c5', 'abfbbfcf-35f9-4a7d-a3ba-82a9f2186355'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:35:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d9e4f5f7-95c6-4d71-b726-16882c4a77f2 tempest-TestServerVolumeAttachmentScenario-346953665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d9e4f5f7-95c6-4d71-b726-16882c4a77f2 tempest-TestServerVolumeAttachmentScenario-346953665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:26 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d9e4f5f7-95c6-4d71-b726-16882c4a77f2 tempest-TestServerVolumeAttachmentScenario-346953665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:35:26 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d9e4f5f7-95c6-4d71-b726-16882c4a77f2 tempest-TestServerVolumeAttachmentScenario-346953665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:35:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d9e4f5f7-95c6-4d71-b726-16882c4a77f2 tempest-TestServerVolumeAttachmentScenario-346953665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d9e4f5f7-95c6-4d71-b726-16882c4a77f2 tempest-TestServerVolumeAttachmentScenario-346953665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:26 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:35:26 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:27 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d6aea85a-c464-4506-b976-a44bd88db80c tempest-TestServerVolumeAttachmentScenario-346953665 None] Acquiring lock "cinder-aeb498a9-9cde-439d-9998-335568ac7aef-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:35:27 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d6aea85a-c464-4506-b976-a44bd88db80c tempest-TestServerVolumeAttachmentScenario-346953665 None] Lock "cinder-aeb498a9-9cde-439d-9998-335568ac7aef-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:35:27 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d9e4f5f7-95c6-4d71-b726-16882c4a77f2 tempest-TestServerVolumeAttachmentScenario-346953665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.412s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:27 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-d9e4f5f7-95c6-4d71-b726-16882c4a77f2 tempest-TestServerVolumeAttachmentScenario-346953665 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:35:27 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-d9e4f5f7-95c6-4d71-b726-16882c4a77f2 tempest-TestServerVolumeAttachmentScenario-346953665 None] Deleted volume successfully. Nov 06 14:35:27 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d6aea85a-c464-4506-b976-a44bd88db80c tempest-TestServerVolumeAttachmentScenario-346953665 None] Acquiring lock "cinder-quobyte-aeb498a9-9cde-439d-9998-335568ac7aef" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:35:27 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d9e4f5f7-95c6-4d71-b726-16882c4a77f2 tempest-TestServerVolumeAttachmentScenario-346953665 None] Lock "cinder-16cd4667-5861-44a0-be4f-8f3685e531bb-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:35:27 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d6aea85a-c464-4506-b976-a44bd88db80c tempest-TestServerVolumeAttachmentScenario-346953665 None] Lock "cinder-quobyte-aeb498a9-9cde-439d-9998-335568ac7aef" acquired by "delete_volume" :: waited 0.031s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:35:27 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c53e1d-e876-4266-a529-291040786d4a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:35:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d6aea85a-c464-4506-b976-a44bd88db80c tempest-TestServerVolumeAttachmentScenario-346953665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aeb498a9-9cde-439d-9998-335568ac7aef {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:27 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aeb498a9-9cde-439d-9998-335568ac7aef Nov 06 14:35:27 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:27 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-e25a3d6a-2038-4ce5-aff1-261f9242338d tempest-GroupSnapshotsTest-181620141 None] Update group completed successfully. Nov 06 14:35:27 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d6aea85a-c464-4506-b976-a44bd88db80c tempest-TestServerVolumeAttachmentScenario-346953665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aeb498a9-9cde-439d-9998-335568ac7aef" returned: 0 in 0.563s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d6aea85a-c464-4506-b976-a44bd88db80c tempest-TestServerVolumeAttachmentScenario-346953665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aeb498a9-9cde-439d-9998-335568ac7aef {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:27 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aeb498a9-9cde-439d-9998-335568ac7aef Nov 06 14:35:27 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:28 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d6aea85a-c464-4506-b976-a44bd88db80c tempest-TestServerVolumeAttachmentScenario-346953665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aeb498a9-9cde-439d-9998-335568ac7aef" returned: 0 in 0.448s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d6aea85a-c464-4506-b976-a44bd88db80c tempest-TestServerVolumeAttachmentScenario-346953665 None] Lock "cinder-quobyte-aeb498a9-9cde-439d-9998-335568ac7aef" released by "delete_volume" :: held 1.077s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:35:28 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-d6aea85a-c464-4506-b976-a44bd88db80c tempest-TestServerVolumeAttachmentScenario-346953665 None] Created reservations ['953fc807-907d-420a-ae8f-a89ab3dbd5a8', '1eae2137-e10c-46fa-8dd1-3ae26d63ee17', '75a8eeb7-49d8-43c5-88b0-e30504d5d268', '62c12aed-b2aa-4067-8297-f4d95596d441'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:35:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d6aea85a-c464-4506-b976-a44bd88db80c tempest-TestServerVolumeAttachmentScenario-346953665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d6aea85a-c464-4506-b976-a44bd88db80c tempest-TestServerVolumeAttachmentScenario-346953665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d6aea85a-c464-4506-b976-a44bd88db80c tempest-TestServerVolumeAttachmentScenario-346953665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:35:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d6aea85a-c464-4506-b976-a44bd88db80c tempest-TestServerVolumeAttachmentScenario-346953665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:35:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d6aea85a-c464-4506-b976-a44bd88db80c tempest-TestServerVolumeAttachmentScenario-346953665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d6aea85a-c464-4506-b976-a44bd88db80c tempest-TestServerVolumeAttachmentScenario-346953665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:28 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:35:28 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:28 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-066d3eac-4374-4da5-a03e-4b78b90cbcac tempest-GroupSnapshotsTest-181620141 None] Update group completed successfully. Nov 06 14:35:28 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d6aea85a-c464-4506-b976-a44bd88db80c tempest-TestServerVolumeAttachmentScenario-346953665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.338s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:28 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-d6aea85a-c464-4506-b976-a44bd88db80c tempest-TestServerVolumeAttachmentScenario-346953665 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:35:28 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-d6aea85a-c464-4506-b976-a44bd88db80c tempest-TestServerVolumeAttachmentScenario-346953665 None] Deleted volume successfully. Nov 06 14:35:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d6aea85a-c464-4506-b976-a44bd88db80c tempest-TestServerVolumeAttachmentScenario-346953665 None] Lock "cinder-aeb498a9-9cde-439d-9998-335568ac7aef-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:35:29 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-c6794cf3-10d2-43c4-b8be-500428f2edc9 tempest-GroupSnapshotsTest-181620141 None] Update group completed successfully. Nov 06 14:35:31 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] GroupSnapshot 2eb1347d-00aa-4216-a7e5-56e136f917f9: creating. Nov 06 14:35:31 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] Group snapshot 2eb1347d-00aa-4216-a7e5-56e136f917f9: creating. {{(pid=86854) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 14:35:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:31 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] Creating offline snapshot b8d40123-dc4f-4f15-95a8-4a640adb932e of volume f901cf84-1a8f-4f96-a9af-9dc85624d317 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:35:31 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d931db6-b651-4563-8f25-55c352d6451f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:35:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:31 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317 Nov 06 14:35:31 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:32 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317" returned: 0 in 0.501s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317.b8d40123-dc4f-4f15-95a8-4a640adb932e 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:32 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317.b8d40123-dc4f-4f15-95a8-4a640adb932e 1G Nov 06 14:35:32 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:32 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317.b8d40123-dc4f-4f15-95a8-4a640adb932e 1G" returned: 0 in 0.542s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f901cf84-1a8f-4f96-a9af-9dc85624d317 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317.b8d40123-dc4f-4f15-95a8-4a640adb932e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:32 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f901cf84-1a8f-4f96-a9af-9dc85624d317 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317.b8d40123-dc4f-4f15-95a8-4a640adb932e Nov 06 14:35:32 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:32 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f901cf84-1a8f-4f96-a9af-9dc85624d317 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317.b8d40123-dc4f-4f15-95a8-4a640adb932e" returned: 0 in 0.367s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:32 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317.b8d40123-dc4f-4f15-95a8-4a640adb932e is being set with open permissions: ugo+rw: NotImplementedError Nov 06 14:35:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317.b8d40123-dc4f-4f15-95a8-4a640adb932e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:33 devstack sudo[98018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317.b8d40123-dc4f-4f15-95a8-4a640adb932e Nov 06 14:35:33 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:33 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317.b8d40123-dc4f-4f15-95a8-4a640adb932e" returned: 0 in 0.641s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:33 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317.info Nov 06 14:35:33 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:34 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317.info" returned: 0 in 0.416s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:34 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 14:35:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:34 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317.info Nov 06 14:35:34 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:34 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317.info" returned: 0 in 0.357s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.966s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:34 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] Creating offline snapshot db2314ea-eae4-49a8-8b97-50eefd83774d of volume 42e6d37c-4a42-453f-90fa-0cbfadf9279f {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:35:34 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[39343c69-62bf-493e-9903-a7c9b6318679]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:35:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:34 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f Nov 06 14:35:34 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:35 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f" returned: 0 in 0.728s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f.db2314ea-eae4-49a8-8b97-50eefd83774d 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:35 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f.db2314ea-eae4-49a8-8b97-50eefd83774d 1G Nov 06 14:35:35 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:36 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f.db2314ea-eae4-49a8-8b97-50eefd83774d 1G" returned: 0 in 0.874s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f.db2314ea-eae4-49a8-8b97-50eefd83774d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:36 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f.db2314ea-eae4-49a8-8b97-50eefd83774d Nov 06 14:35:36 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:36 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f.db2314ea-eae4-49a8-8b97-50eefd83774d" returned: 0 in 0.659s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:36 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f.db2314ea-eae4-49a8-8b97-50eefd83774d is being set with open permissions: ugo+rw: NotImplementedError Nov 06 14:35:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f.db2314ea-eae4-49a8-8b97-50eefd83774d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:36 devstack sudo[98063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f.db2314ea-eae4-49a8-8b97-50eefd83774d Nov 06 14:35:36 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:37 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f.db2314ea-eae4-49a8-8b97-50eefd83774d" returned: 0 in 0.309s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:37 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f.info Nov 06 14:35:37 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:37 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f.info" returned: 0 in 0.369s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:37 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 14:35:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:37 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f.info Nov 06 14:35:37 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:37 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f.info" returned: 0 in 0.308s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.475s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:38 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-f9e21418-2cf2-4bb1-a01b-7f377fff91a8 tempest-GroupSnapshotsTest-181620141 None] group_snapshot 2eb1347d-00aa-4216-a7e5-56e136f917f9: created successfully Nov 06 14:35:39 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] group_snapshot 2eb1347d-00aa-4216-a7e5-56e136f917f9: deleting Nov 06 14:35:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] group_snapshot 2eb1347d-00aa-4216-a7e5-56e136f917f9: deleting {{(pid=86854) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 14:35:39 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "cinder-quobyte-f901cf84-1a8f-4f96-a9af-9dc85624d317" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:35:39 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-f901cf84-1a8f-4f96-a9af-9dc85624d317" acquired by "delete_snapshot" :: waited 0.103s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:35:39 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "cinder-quobyte-b8d40123-dc4f-4f15-95a8-4a640adb932e" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:35:39 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-b8d40123-dc4f-4f15-95a8-4a640adb932e" acquired by "_delete_snapshot" :: waited 0.066s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:35:39 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] Deleting offline snapshot b8d40123-dc4f-4f15-95a8-4a640adb932e of volume f901cf84-1a8f-4f96-a9af-9dc85624d317 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:35:39 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] snapshot_file for this snap is: volume-f901cf84-1a8f-4f96-a9af-9dc85624d317.b8d40123-dc4f-4f15-95a8-4a640adb932e {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:35:39 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4ca72a-f9ab-48a9-a67f-e8ec27c0bebc]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:35:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317.b8d40123-dc4f-4f15-95a8-4a640adb932e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:39 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317.b8d40123-dc4f-4f15-95a8-4a640adb932e Nov 06 14:35:39 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:40 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317.b8d40123-dc4f-4f15-95a8-4a640adb932e" returned: 0 in 1.064s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:40 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f901cf84-1a8f-4f96-a9af-9dc85624d317(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:35:40 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe6d54a-f91d-456a-ae15-dd11618696a0]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:35:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:41 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317 Nov 06 14:35:41 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:41 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317" returned: 0 in 0.823s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317.b8d40123-dc4f-4f15-95a8-4a640adb932e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:41 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317.b8d40123-dc4f-4f15-95a8-4a640adb932e Nov 06 14:35:41 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:42 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317.b8d40123-dc4f-4f15-95a8-4a640adb932e" returned: 0 in 0.712s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317.b8d40123-dc4f-4f15-95a8-4a640adb932e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:42 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317.b8d40123-dc4f-4f15-95a8-4a640adb932e Nov 06 14:35:42 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:42 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317.b8d40123-dc4f-4f15-95a8-4a640adb932e" returned: 0 in 0.548s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:42 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-b8d40123-dc4f-4f15-95a8-4a640adb932e" released by "_delete_snapshot" :: held 3.425s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:35:42 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-f901cf84-1a8f-4f96-a9af-9dc85624d317" released by "delete_snapshot" :: held 3.506s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:35:42 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=113,cinder:UPDATE=68,cinder:INSERT=16,cinder:DELETE=3 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:35:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "cinder-quobyte-42e6d37c-4a42-453f-90fa-0cbfadf9279f" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:35:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-42e6d37c-4a42-453f-90fa-0cbfadf9279f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:35:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "cinder-quobyte-db2314ea-eae4-49a8-8b97-50eefd83774d" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:35:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-db2314ea-eae4-49a8-8b97-50eefd83774d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:35:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] Deleting offline snapshot db2314ea-eae4-49a8-8b97-50eefd83774d of volume 42e6d37c-4a42-453f-90fa-0cbfadf9279f {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:35:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] snapshot_file for this snap is: volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f.db2314ea-eae4-49a8-8b97-50eefd83774d {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:35:43 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[9661bae4-232a-4d63-814c-18d71132c3f6]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:35:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f.db2314ea-eae4-49a8-8b97-50eefd83774d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:43 devstack sudo[98168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f.db2314ea-eae4-49a8-8b97-50eefd83774d Nov 06 14:35:43 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:43 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f.db2314ea-eae4-49a8-8b97-50eefd83774d" returned: 0 in 0.443s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:35:43 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21de08c-f5ed-4cdf-98c7-323bfb7e390d]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:35:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:43 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f Nov 06 14:35:43 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:44 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f" returned: 0 in 0.587s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f.db2314ea-eae4-49a8-8b97-50eefd83774d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:44 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f.db2314ea-eae4-49a8-8b97-50eefd83774d Nov 06 14:35:44 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:44 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f.db2314ea-eae4-49a8-8b97-50eefd83774d" returned: 0 in 0.697s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f.db2314ea-eae4-49a8-8b97-50eefd83774d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:44 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f.db2314ea-eae4-49a8-8b97-50eefd83774d Nov 06 14:35:44 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:45 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f.db2314ea-eae4-49a8-8b97-50eefd83774d" returned: 0 in 0.417s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-db2314ea-eae4-49a8-8b97-50eefd83774d" released by "_delete_snapshot" :: held 2.321s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:35:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-42e6d37c-4a42-453f-90fa-0cbfadf9279f" released by "delete_snapshot" :: held 2.357s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:35:45 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=99,cinder:INSERT=15,cinder:UPDATE=90,cinder:DELETE=4 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:35:45 devstack cinder-volume[86854]: WARNING cinder.quota [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1881293123 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1881293123, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:35:45 devstack cinder-volume[86854]: WARNING cinder.quota [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1881293123 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1881293123, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:35:45 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] Created reservations ['3697bd28-2923-416d-99bc-bc085ab56fef', 'a782cfa0-8f33-41c7-a6ec-cbcbd942dfc8', 'c1aeac25-250b-4361-84c9-7b9a03781a20', '808cc0bc-4f24-421b-8d0d-e255d5bff681'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:35:45 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] Created reservations ['f9606c62-ae4c-4bff-892c-a675b3b8af68', 'b716a81b-6c00-4cd4-90f8-8c04a3eafaf2', '1ba726ca-d576-4be0-a556-3c1725c138d7', '3567b8d5-d09c-4a68-9be6-f47be7829a9f'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:35:46 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-1df48e04-95b5-4862-b8df-9d844283d7c5 tempest-GroupSnapshotsTest-181620141 None] group_snapshot 2eb1347d-00aa-4216-a7e5-56e136f917f9: deleted successfully Nov 06 14:35:46 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-cda947a7-0ba3-49cb-a1d0-3a6387a24675 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "cinder-quobyte-42e6d37c-4a42-453f-90fa-0cbfadf9279f" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:35:47 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-cda947a7-0ba3-49cb-a1d0-3a6387a24675 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-42e6d37c-4a42-453f-90fa-0cbfadf9279f" acquired by "delete_volume" :: waited 0.032s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:35:47 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[75618b15-c39e-4e7a-b9e4-3e630def0f40]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:35:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cda947a7-0ba3-49cb-a1d0-3a6387a24675 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:47 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f Nov 06 14:35:47 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:47 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cda947a7-0ba3-49cb-a1d0-3a6387a24675 tempest-GroupSnapshotsTest-181620141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f" returned: 0 in 0.649s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cda947a7-0ba3-49cb-a1d0-3a6387a24675 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:47 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f Nov 06 14:35:47 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:48 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cda947a7-0ba3-49cb-a1d0-3a6387a24675 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-42e6d37c-4a42-453f-90fa-0cbfadf9279f" returned: 0 in 0.300s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-cda947a7-0ba3-49cb-a1d0-3a6387a24675 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-42e6d37c-4a42-453f-90fa-0cbfadf9279f" released by "delete_volume" :: held 1.043s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-cda947a7-0ba3-49cb-a1d0-3a6387a24675 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "cinder-quobyte-f901cf84-1a8f-4f96-a9af-9dc85624d317" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-cda947a7-0ba3-49cb-a1d0-3a6387a24675 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-f901cf84-1a8f-4f96-a9af-9dc85624d317" acquired by "delete_volume" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ce599a-d35b-4c9e-b543-c4be724635e4]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cda947a7-0ba3-49cb-a1d0-3a6387a24675 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:48 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317 Nov 06 14:35:48 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Flow 'volume_create_manager' (4ffdc256-7995-4f1b-acc0-a583a3cad591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68dfffd-8a8b-41df-aa09-351f806f81ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68dfffd-8a8b-41df-aa09-351f806f81ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-432923168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f989ee6-167e-4d29-9394-ceb179dae2aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2239425dfb8245918424b9b54be1db26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:35:49Z,use_quota=True,user_id='bf0ebdb483064dda8c2f47b3a91b4881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (017ce669-8c10-4d1b-be81-5bf7263bf558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (017ce669-8c10-4d1b-be81-5bf7263bf558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb4f157-3a96-42d4-9769-964efc895fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb4f157-3a96-42d4-9769-964efc895fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f989ee6-167e-4d29-9394-ceb179dae2aa', 'volume_name': 'volume-9f989ee6-167e-4d29-9394-ceb179dae2aa', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:48 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86d1526-db7a-4d27-8dd7-fcb8db3c4534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86d1526-db7a-4d27-8dd7-fcb8db3c4534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba5dd86-8855-4236-a394-8a13a02e10e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:48 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Volume 9f989ee6-167e-4d29-9394-ceb179dae2aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f989ee6-167e-4d29-9394-ceb179dae2aa', 'volume_size': 1} Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-432923168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f989ee6-167e-4d29-9394-ceb179dae2aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2239425dfb8245918424b9b54be1db26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:35:49Z,use_quota=True,user_id='bf0ebdb483064dda8c2f47b3a91b4881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Creating volume 9f989ee6-167e-4d29-9394-ceb179dae2aa {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:35:48 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cda947a7-0ba3-49cb-a1d0-3a6387a24675 tempest-GroupSnapshotsTest-181620141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317" returned: 0 in 0.586s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cda947a7-0ba3-49cb-a1d0-3a6387a24675 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:48 devstack sudo[98207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa 1073741824 Nov 06 14:35:48 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:48 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317 Nov 06 14:35:48 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:49 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cda947a7-0ba3-49cb-a1d0-3a6387a24675 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f901cf84-1a8f-4f96-a9af-9dc85624d317" returned: 0 in 0.303s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:49 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-cda947a7-0ba3-49cb-a1d0-3a6387a24675 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-f901cf84-1a8f-4f96-a9af-9dc85624d317" released by "delete_volume" :: held 0.966s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:35:49 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-cda947a7-0ba3-49cb-a1d0-3a6387a24675 tempest-GroupSnapshotsTest-181620141 None] Created reservations ['81042083-7afa-4afc-855a-057c310a5fcc'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:35:49 devstack cinder-volume[86854]: WARNING cinder.quota [None req-cda947a7-0ba3-49cb-a1d0-3a6387a24675 tempest-GroupSnapshotsTest-181620141 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1881293123 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1881293123, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:35:49 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-cda947a7-0ba3-49cb-a1d0-3a6387a24675 tempest-GroupSnapshotsTest-181620141 None] Created reservations ['112dcab6-dded-42cd-af4c-2f5f0b850b1d', '3994914d-b8b1-467f-a559-76d68a2a80e9', '9731177c-65c7-47d5-837e-c75220ec69b9', 'c0ae5ab5-305e-48ef-bb03-3305c3f2e20a'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:35:49 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa 1073741824" returned: 0 in 0.497s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:49 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa Nov 06 14:35:49 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:49 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-cda947a7-0ba3-49cb-a1d0-3a6387a24675 tempest-GroupSnapshotsTest-181620141 None] Created reservations ['394e992b-bdcf-4d64-baa0-fb3527993be0', 'a47ac7a2-0540-45f7-a31f-c18470f4ce46', '845085ab-f27e-42db-a6cf-d791e5838b49', 'd8fb6e3b-0abc-4034-944f-2fea7bab6e15'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:35:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-cda947a7-0ba3-49cb-a1d0-3a6387a24675 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-cda947a7-0ba3-49cb-a1d0-3a6387a24675 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:49 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-cda947a7-0ba3-49cb-a1d0-3a6387a24675 tempest-GroupSnapshotsTest-181620141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:35:49 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-cda947a7-0ba3-49cb-a1d0-3a6387a24675 tempest-GroupSnapshotsTest-181620141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:35:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-cda947a7-0ba3-49cb-a1d0-3a6387a24675 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cda947a7-0ba3-49cb-a1d0-3a6387a24675 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:49 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:35:49 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:49 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa" returned: 0 in 0.319s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:49 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:35:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba5dd86-8855-4236-a394-8a13a02e10e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f989ee6-167e-4d29-9394-ceb179dae2aa', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9356b76-d678-4c0c-9a9d-298c67e53075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:49 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Volume volume-9f989ee6-167e-4d29-9394-ceb179dae2aa (9f989ee6-167e-4d29-9394-ceb179dae2aa): created successfully Nov 06 14:35:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9356b76-d678-4c0c-9a9d-298c67e53075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Flow 'volume_create_manager' (4ffdc256-7995-4f1b-acc0-a583a3cad591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:35:49 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-86088535-7b82-4b42-a305-03eff0fccf92 tempest-CreateVolumesFromSnapshotTest-808533590 None] Created volume successfully. Nov 06 14:35:49 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cda947a7-0ba3-49cb-a1d0-3a6387a24675 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.318s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:49 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-cda947a7-0ba3-49cb-a1d0-3a6387a24675 tempest-GroupSnapshotsTest-181620141 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:35:49 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-cda947a7-0ba3-49cb-a1d0-3a6387a24675 tempest-GroupSnapshotsTest-181620141 None] Delete group completed successfully. Nov 06 14:35:50 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-683164ac-ff0e-4c14-b23f-89c3a5482f8e tempest-GroupSnapshotsTest-181620141 None] Group tempest-GroupSnapshotsTest-Group-2097833093: creating Nov 06 14:35:50 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-683164ac-ff0e-4c14-b23f-89c3a5482f8e tempest-GroupSnapshotsTest-181620141 None] Group tempest-GroupSnapshotsTest-Group-2097833093: created successfully Nov 06 14:35:50 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-683164ac-ff0e-4c14-b23f-89c3a5482f8e tempest-GroupSnapshotsTest-181620141 None] Create group completed successfully. Nov 06 14:35:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-92a77577-e34d-40c4-859c-ba9a038684b6 tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-92a77577-e34d-40c4-859c-ba9a038684b6 tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:50 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-92a77577-e34d-40c4-859c-ba9a038684b6 tempest-CreateVolumesFromSnapshotTest-808533590 None] Creating offline snapshot 239f3a52-cf0d-4a34-9894-5ff4e4b405cf of volume 9f989ee6-167e-4d29-9394-ceb179dae2aa {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:35:50 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dbe9fe-2385-4858-944f-76eed4760898]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:35:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-92a77577-e34d-40c4-859c-ba9a038684b6 tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:51 devstack sudo[98222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa Nov 06 14:35:51 devstack sudo[98222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:51 devstack sudo[98222]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-92a77577-e34d-40c4-859c-ba9a038684b6 tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa" returned: 0 in 0.357s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-92a77577-e34d-40c4-859c-ba9a038684b6 tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa.239f3a52-cf0d-4a34-9894-5ff4e4b405cf 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:51 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa.239f3a52-cf0d-4a34-9894-5ff4e4b405cf 1G Nov 06 14:35:51 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:51 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-92a77577-e34d-40c4-859c-ba9a038684b6 tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa.239f3a52-cf0d-4a34-9894-5ff4e4b405cf 1G" returned: 0 in 0.461s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-92a77577-e34d-40c4-859c-ba9a038684b6 tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f989ee6-167e-4d29-9394-ceb179dae2aa -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa.239f3a52-cf0d-4a34-9894-5ff4e4b405cf {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:51 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f989ee6-167e-4d29-9394-ceb179dae2aa -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa.239f3a52-cf0d-4a34-9894-5ff4e4b405cf Nov 06 14:35:51 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Flow 'volume_create_manager' (b8add825-d403-4f21-b617-057ebd1bf058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:35:52 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ba55113-a65f-4fcd-b1cd-6c493dd1e370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-92a77577-e34d-40c4-859c-ba9a038684b6 tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f989ee6-167e-4d29-9394-ceb179dae2aa -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa.239f3a52-cf0d-4a34-9894-5ff4e4b405cf" returned: 0 in 0.384s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:52 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-92a77577-e34d-40c4-859c-ba9a038684b6 tempest-CreateVolumesFromSnapshotTest-808533590 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa.239f3a52-cf0d-4a34-9894-5ff4e4b405cf is being set with open permissions: ugo+rw Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-92a77577-e34d-40c4-859c-ba9a038684b6 tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa.239f3a52-cf0d-4a34-9894-5ff4e4b405cf {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ba55113-a65f-4fcd-b1cd-6c493dd1e370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1201787278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=09d899d4-61b9-4162-9225-5dc552ac4530,host='devstack@QuobyteHD#QuobyteHD',id=af78f2a3-4c41-4218-ae9c-27c593b2151b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4d1aebc48e40b5bc58fc6706dc979f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:35:52Z,use_quota=True,user_id='86183259047f45039c3729334eb742f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(824fecaf-81a2-4899-8588-526d65fa944b),volume_type_id=824fecaf-81a2-4899-8588-526d65fa944b)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:52 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa.239f3a52-cf0d-4a34-9894-5ff4e4b405cf Nov 06 14:35:52 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22bdad32-7844-44e4-a3a7-b7c8cfa964ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22bdad32-7844-44e4-a3a7-b7c8cfa964ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4680d01f-0b6c-4cba-9d0a-b370a6eaa4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4680d01f-0b6c-4cba-9d0a-b370a6eaa4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af78f2a3-4c41-4218-ae9c-27c593b2151b', 'volume_name': 'volume-af78f2a3-4c41-4218-ae9c-27c593b2151b', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f374f3b3-c2ed-4737-8c05-309c3572089b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f374f3b3-c2ed-4737-8c05-309c3572089b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a094ab-4589-4b3f-8389-7739f061feec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:52 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Volume af78f2a3-4c41-4218-ae9c-27c593b2151b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af78f2a3-4c41-4218-ae9c-27c593b2151b', 'volume_size': 1} Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:52 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-92a77577-e34d-40c4-859c-ba9a038684b6 tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa.239f3a52-cf0d-4a34-9894-5ff4e4b405cf" returned: 0 in 0.274s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-92a77577-e34d-40c4-859c-ba9a038684b6 tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:52 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa.info Nov 06 14:35:52 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:52 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-92a77577-e34d-40c4-859c-ba9a038684b6 tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa.info" returned: 0 in 0.255s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:52 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-92a77577-e34d-40c4-859c-ba9a038684b6 tempest-CreateVolumesFromSnapshotTest-808533590 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa.info is being set with open permissions: ugo+rw Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-92a77577-e34d-40c4-859c-ba9a038684b6 tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:52 devstack sudo[98245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa.info Nov 06 14:35:52 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:52 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-92a77577-e34d-40c4-859c-ba9a038684b6 tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa.info" returned: 0 in 0.250s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-92a77577-e34d-40c4-859c-ba9a038684b6 tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.080s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.771s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=09d899d4-61b9-4162-9225-5dc552ac4530,created_at=2026-11-06T13:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1201787278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=09d899d4-61b9-4162-9225-5dc552ac4530,host='devstack@QuobyteHD#QuobyteHD',id=af78f2a3-4c41-4218-ae9c-27c593b2151b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4d1aebc48e40b5bc58fc6706dc979f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:35:52Z,use_quota=True,user_id='86183259047f45039c3729334eb742f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(824fecaf-81a2-4899-8588-526d65fa944b),volume_type_id=824fecaf-81a2-4899-8588-526d65fa944b)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Creating volume af78f2a3-4c41-4218-ae9c-27c593b2151b {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:35:52 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:35:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:53 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b 1073741824 Nov 06 14:35:53 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:53 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-92a77577-e34d-40c4-859c-ba9a038684b6 tempest-CreateVolumesFromSnapshotTest-808533590 None] Create snapshot completed successfully Nov 06 14:35:53 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b 1073741824" returned: 0 in 0.527s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:53 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b Nov 06 14:35:53 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:53 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b" returned: 0 in 0.285s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:53 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:35:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a094ab-4589-4b3f-8389-7739f061feec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af78f2a3-4c41-4218-ae9c-27c593b2151b', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c2888fb-de14-41be-8017-3077e5c6c48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:53 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Volume volume-af78f2a3-4c41-4218-ae9c-27c593b2151b (af78f2a3-4c41-4218-ae9c-27c593b2151b): created successfully Nov 06 14:35:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c2888fb-de14-41be-8017-3077e5c6c48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Flow 'volume_create_manager' (b8add825-d403-4f21-b617-057ebd1bf058) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:35:53 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-b5839158-91c6-4f32-aa3f-32d62a35be22 tempest-GroupSnapshotsTest-181620141 None] Created volume successfully. Nov 06 14:35:54 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-a44f5fb2-b9a4-4939-a8a0-7482a97e28f9 tempest-GroupSnapshotsTest-181620141 None] GroupSnapshot 408a983a-8805-4622-875b-2eab54d19ced: creating. Nov 06 14:35:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a44f5fb2-b9a4-4939-a8a0-7482a97e28f9 tempest-GroupSnapshotsTest-181620141 None] Group snapshot 408a983a-8805-4622-875b-2eab54d19ced: creating. {{(pid=86854) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 14:35:54 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:35:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Flow 'volume_create_manager' (ce15f6ac-e085-4b46-a151-568b2ced17c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:35:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d76bb2c-72a3-4165-b314-24ba2f6bd249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d76bb2c-72a3-4165-b314-24ba2f6bd249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1705779479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f08c382-8993-4f27-a3ef-591f4005f70b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2239425dfb8245918424b9b54be1db26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:35:55Z,use_quota=True,user_id='bf0ebdb483064dda8c2f47b3a91b4881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b50871-302f-4f63-8381-d3b8e30f2d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b50871-302f-4f63-8381-d3b8e30f2d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb4d1c0-3ff0-4b4b-bb17-6a5ee6e18e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb4d1c0-3ff0-4b4b-bb17-6a5ee6e18e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f08c382-8993-4f27-a3ef-591f4005f70b', 'volume_name': 'volume-7f08c382-8993-4f27-a3ef-591f4005f70b', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd2c496-2195-47c4-b21d-0711f9a5fe5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd2c496-2195-47c4-b21d-0711f9a5fe5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d11251b0-3c2f-4ad0-ae50-0d9cd6edb778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:54 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Volume 7f08c382-8993-4f27-a3ef-591f4005f70b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f08c382-8993-4f27-a3ef-591f4005f70b', 'volume_size': 1} Nov 06 14:35:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1705779479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f08c382-8993-4f27-a3ef-591f4005f70b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2239425dfb8245918424b9b54be1db26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:35:55Z,use_quota=True,user_id='bf0ebdb483064dda8c2f47b3a91b4881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:35:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Creating volume 7f08c382-8993-4f27-a3ef-591f4005f70b {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:35:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:35:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:35:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:35:54 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:35:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7f08c382-8993-4f27-a3ef-591f4005f70b 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a44f5fb2-b9a4-4939-a8a0-7482a97e28f9 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:54 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7f08c382-8993-4f27-a3ef-591f4005f70b 1073741824 Nov 06 14:35:54 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Flow 'volume_create_manager' (463ce5f5-f362-4779-aec3-6431bc8f27b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f7c37f3-3fe5-4326-9506-58226dae5ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f7c37f3-3fe5-4326-9506-58226dae5ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1559695803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c98d3c08-0cd7-4a19-8939-ea7758b32ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2239425dfb8245918424b9b54be1db26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:35:55Z,use_quota=True,user_id='bf0ebdb483064dda8c2f47b3a91b4881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e328d35e-6852-4630-8e1a-de70d32d21b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e328d35e-6852-4630-8e1a-de70d32d21b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351e7c9b-39fb-407a-892e-1838a8c13bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351e7c9b-39fb-407a-892e-1838a8c13bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c98d3c08-0cd7-4a19-8939-ea7758b32ef4', 'volume_name': 'volume-c98d3c08-0cd7-4a19-8939-ea7758b32ef4', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1a40aa-2466-495f-8865-f0466a4a8ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1a40aa-2466-495f-8865-f0466a4a8ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3982507c-67d0-4f44-a6bf-e9b763d20b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:55 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Volume c98d3c08-0cd7-4a19-8939-ea7758b32ef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c98d3c08-0cd7-4a19-8939-ea7758b32ef4', 'volume_size': 1} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:55 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7f08c382-8993-4f27-a3ef-591f4005f70b 1073741824" returned: 0 in 0.658s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7f08c382-8993-4f27-a3ef-591f4005f70b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:55 devstack sudo[98280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7f08c382-8993-4f27-a3ef-591f4005f70b Nov 06 14:35:55 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Flow 'volume_create_manager' (41943d36-8ea5-46d0-b913-f81b27a67e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (076bcd46-f68b-423c-8c4f-94aa17f73fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (076bcd46-f68b-423c-8c4f-94aa17f73fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-600776717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48bbfd90-7808-4108-a3f4-41f0e726e768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2239425dfb8245918424b9b54be1db26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:35:56Z,use_quota=True,user_id='bf0ebdb483064dda8c2f47b3a91b4881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1184a8-ddbd-4708-9a11-22528272a222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1184a8-ddbd-4708-9a11-22528272a222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b31cca3f-9158-409d-a040-6a2bcaae6529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b31cca3f-9158-409d-a040-6a2bcaae6529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48bbfd90-7808-4108-a3f4-41f0e726e768', 'volume_name': 'volume-48bbfd90-7808-4108-a3f4-41f0e726e768', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7353139-b97b-44d6-b471-a307abcf8d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7353139-b97b-44d6-b471-a307abcf8d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a6d132-a615-4f35-8c91-335e144909e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:55 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Volume 48bbfd90-7808-4108-a3f4-41f0e726e768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48bbfd90-7808-4108-a3f4-41f0e726e768', 'volume_size': 1} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:55 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7f08c382-8993-4f27-a3ef-591f4005f70b" returned: 0 in 0.358s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a44f5fb2-b9a4-4939-a8a0-7482a97e28f9 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.045s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-a44f5fb2-b9a4-4939-a8a0-7482a97e28f9 tempest-GroupSnapshotsTest-181620141 None] Creating offline snapshot bfdf6fb8-c88f-422e-ae8d-c2d7acccbb91 of volume af78f2a3-4c41-4218-ae9c-27c593b2151b {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d11251b0-3c2f-4ad0-ae50-0d9cd6edb778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f08c382-8993-4f27-a3ef-591f4005f70b', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71efbe53-ad92-4c55-ad09-b6b3f2c86b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[072e7eae-a8cc-4e21-9a0b-4f4d14b76934]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:35:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a44f5fb2-b9a4-4939-a8a0-7482a97e28f9 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:56 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Volume volume-7f08c382-8993-4f27-a3ef-591f4005f70b (7f08c382-8993-4f27-a3ef-591f4005f70b): created successfully Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71efbe53-ad92-4c55-ad09-b6b3f2c86b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Flow 'volume_create_manager' (ce15f6ac-e085-4b46-a151-568b2ced17c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:35:56 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-8d06b1ee-cf42-44b9-aa13-3c38b28c0798 tempest-CreateVolumesFromSnapshotTest-808533590 None] Created volume successfully. Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Flow 'volume_create_manager' (44edc09b-ccf2-4471-9f00-faca57621052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:35:56 devstack sudo[98283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b Nov 06 14:35:56 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319aaad7-6e14-480e-a204-c5015b605ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319aaad7-6e14-480e-a204-c5015b605ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1848883060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f57fb7e-cb91-49e8-aa72-9add6cc1bb0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2239425dfb8245918424b9b54be1db26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:35:56Z,use_quota=True,user_id='bf0ebdb483064dda8c2f47b3a91b4881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64457f3b-8158-4465-b0d1-f6deb98dda65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64457f3b-8158-4465-b0d1-f6deb98dda65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91cb8684-479c-43ad-9d73-ae2067d1caba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91cb8684-479c-43ad-9d73-ae2067d1caba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f57fb7e-cb91-49e8-aa72-9add6cc1bb0e', 'volume_name': 'volume-0f57fb7e-cb91-49e8-aa72-9add6cc1bb0e', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc41722-3563-463d-a9af-15c00ce265aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc41722-3563-463d-a9af-15c00ce265aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (917c0b67-c001-4277-b3e0-fc83258eea10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:56 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Volume 0f57fb7e-cb91-49e8-aa72-9add6cc1bb0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f57fb7e-cb91-49e8-aa72-9add6cc1bb0e', 'volume_size': 1} Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:56 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a44f5fb2-b9a4-4939-a8a0-7482a97e28f9 tempest-GroupSnapshotsTest-181620141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b" returned: 0 in 0.503s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a44f5fb2-b9a4-4939-a8a0-7482a97e28f9 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b.bfdf6fb8-c88f-422e-ae8d-c2d7acccbb91 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:56 devstack sudo[98292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b.bfdf6fb8-c88f-422e-ae8d-c2d7acccbb91 1G Nov 06 14:35:56 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Flow 'volume_create_manager' (3137cbf0-1360-4bb6-b302-c2d5f91bf4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6aa1eb-40e5-4b67-8aee-c175947278a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6aa1eb-40e5-4b67-8aee-c175947278a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2146663801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78908b13-33ab-4805-a4bd-5875a7391b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2239425dfb8245918424b9b54be1db26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:35:57Z,use_quota=True,user_id='bf0ebdb483064dda8c2f47b3a91b4881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f20bdb3-4b09-4d48-b557-19148b9570bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f20bdb3-4b09-4d48-b557-19148b9570bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b254939-c1f9-4268-a1ee-acee1fd00a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b254939-c1f9-4268-a1ee-acee1fd00a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78908b13-33ab-4805-a4bd-5875a7391b20', 'volume_name': 'volume-78908b13-33ab-4805-a4bd-5875a7391b20', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (254e93bd-a493-4596-8eb6-24e423ceb435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (254e93bd-a493-4596-8eb6-24e423ceb435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738101c2-d575-4a96-94fa-f18923a7e8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:56 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Volume 78908b13-33ab-4805-a4bd-5875a7391b20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78908b13-33ab-4805-a4bd-5875a7391b20', 'volume_size': 1} Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:56 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a44f5fb2-b9a4-4939-a8a0-7482a97e28f9 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b.bfdf6fb8-c88f-422e-ae8d-c2d7acccbb91 1G" returned: 0 in 0.459s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a44f5fb2-b9a4-4939-a8a0-7482a97e28f9 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af78f2a3-4c41-4218-ae9c-27c593b2151b -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b.bfdf6fb8-c88f-422e-ae8d-c2d7acccbb91 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:56 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af78f2a3-4c41-4218-ae9c-27c593b2151b -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b.bfdf6fb8-c88f-422e-ae8d-c2d7acccbb91 Nov 06 14:35:56 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:57 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a44f5fb2-b9a4-4939-a8a0-7482a97e28f9 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af78f2a3-4c41-4218-ae9c-27c593b2151b -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b.bfdf6fb8-c88f-422e-ae8d-c2d7acccbb91" returned: 0 in 0.329s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:57 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-a44f5fb2-b9a4-4939-a8a0-7482a97e28f9 tempest-GroupSnapshotsTest-181620141 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b.bfdf6fb8-c88f-422e-ae8d-c2d7acccbb91 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 14:35:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a44f5fb2-b9a4-4939-a8a0-7482a97e28f9 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b.bfdf6fb8-c88f-422e-ae8d-c2d7acccbb91 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:57 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b.bfdf6fb8-c88f-422e-ae8d-c2d7acccbb91 Nov 06 14:35:57 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:57 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a44f5fb2-b9a4-4939-a8a0-7482a97e28f9 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b.bfdf6fb8-c88f-422e-ae8d-c2d7acccbb91" returned: 0 in 0.266s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a44f5fb2-b9a4-4939-a8a0-7482a97e28f9 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:57 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b.info Nov 06 14:35:57 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:57 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a44f5fb2-b9a4-4939-a8a0-7482a97e28f9 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b.info" returned: 0 in 0.323s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:57 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-a44f5fb2-b9a4-4939-a8a0-7482a97e28f9 tempest-GroupSnapshotsTest-181620141 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 14:35:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a44f5fb2-b9a4-4939-a8a0-7482a97e28f9 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:57 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b.info Nov 06 14:35:57 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:58 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a44f5fb2-b9a4-4939-a8a0-7482a97e28f9 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b.info" returned: 0 in 0.257s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a44f5fb2-b9a4-4939-a8a0-7482a97e28f9 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.247s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.834s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1559695803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c98d3c08-0cd7-4a19-8939-ea7758b32ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2239425dfb8245918424b9b54be1db26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:35:55Z,use_quota=True,user_id='bf0ebdb483064dda8c2f47b3a91b4881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:35:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Creating volume c98d3c08-0cd7-4a19-8939-ea7758b32ef4 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:35:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:35:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:35:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:35:58 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:35:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c98d3c08-0cd7-4a19-8939-ea7758b32ef4 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:58 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c98d3c08-0cd7-4a19-8939-ea7758b32ef4 1073741824 Nov 06 14:35:58 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:58 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-a44f5fb2-b9a4-4939-a8a0-7482a97e28f9 tempest-GroupSnapshotsTest-181620141 None] group_snapshot 408a983a-8805-4622-875b-2eab54d19ced: created successfully Nov 06 14:35:58 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c98d3c08-0cd7-4a19-8939-ea7758b32ef4 1073741824" returned: 0 in 0.591s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c98d3c08-0cd7-4a19-8939-ea7758b32ef4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:58 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c98d3c08-0cd7-4a19-8939-ea7758b32ef4 Nov 06 14:35:58 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:59 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c98d3c08-0cd7-4a19-8939-ea7758b32ef4" returned: 0 in 0.304s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.318s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-600776717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48bbfd90-7808-4108-a3f4-41f0e726e768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2239425dfb8245918424b9b54be1db26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:35:56Z,use_quota=True,user_id='bf0ebdb483064dda8c2f47b3a91b4881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Creating volume 48bbfd90-7808-4108-a3f4-41f0e726e768 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:35:59 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48bbfd90-7808-4108-a3f4-41f0e726e768 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:59 devstack sudo[98329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48bbfd90-7808-4108-a3f4-41f0e726e768 1073741824 Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3982507c-67d0-4f44-a6bf-e9b763d20b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c98d3c08-0cd7-4a19-8939-ea7758b32ef4', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:59 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ee2bd9-8813-4c70-a026-c43bc77ac1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:35:59 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Volume volume-c98d3c08-0cd7-4a19-8939-ea7758b32ef4 (c98d3c08-0cd7-4a19-8939-ea7758b32ef4): created successfully Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ee2bd9-8813-4c70-a026-c43bc77ac1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Flow 'volume_create_manager' (463ce5f5-f362-4779-aec3-6431bc8f27b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:35:59 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-7c300fe8-a98c-43ca-a541-88ddc6ace4db tempest-CreateVolumesFromSnapshotTest-808533590 None] Created volume successfully. Nov 06 14:35:59 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-42e8c8b8-d5bd-435b-a6c8-7ce3bd94bc34 tempest-GroupSnapshotsTest-181620141 None] group_snapshot 408a983a-8805-4622-875b-2eab54d19ced: deleting Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-42e8c8b8-d5bd-435b-a6c8-7ce3bd94bc34 tempest-GroupSnapshotsTest-181620141 None] group_snapshot 408a983a-8805-4622-875b-2eab54d19ced: deleting {{(pid=86854) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 14:35:59 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-5bbfbc90-8e57-40fc-bb8e-c2274654a591 req-b76e053a-bb43-4902-b6ae-55ec107018f7 tempest-TestMinimumBasicScenario-2070269532 None] Terminate volume connection completed successfully. Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-5bbfbc90-8e57-40fc-bb8e-c2274654a591 req-b76e053a-bb43-4902-b6ae-55ec107018f7 tempest-TestMinimumBasicScenario-2070269532 None] Deleting attachment 4a7f489f-b06b-46f0-bbd6-9a639e491b1b. {{(pid=86854) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-42e8c8b8-d5bd-435b-a6c8-7ce3bd94bc34 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "cinder-quobyte-af78f2a3-4c41-4218-ae9c-27c593b2151b" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-42e8c8b8-d5bd-435b-a6c8-7ce3bd94bc34 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-af78f2a3-4c41-4218-ae9c-27c593b2151b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-42e8c8b8-d5bd-435b-a6c8-7ce3bd94bc34 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "cinder-quobyte-bfdf6fb8-c88f-422e-ae8d-c2d7acccbb91" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-42e8c8b8-d5bd-435b-a6c8-7ce3bd94bc34 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-bfdf6fb8-c88f-422e-ae8d-c2d7acccbb91" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-42e8c8b8-d5bd-435b-a6c8-7ce3bd94bc34 tempest-GroupSnapshotsTest-181620141 None] Deleting offline snapshot bfdf6fb8-c88f-422e-ae8d-c2d7acccbb91 of volume af78f2a3-4c41-4218-ae9c-27c593b2151b {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-42e8c8b8-d5bd-435b-a6c8-7ce3bd94bc34 tempest-GroupSnapshotsTest-181620141 None] snapshot_file for this snap is: volume-af78f2a3-4c41-4218-ae9c-27c593b2151b.bfdf6fb8-c88f-422e-ae8d-c2d7acccbb91 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefe5dcc-56ef-47c1-b9da-a5829e5775cc]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-42e8c8b8-d5bd-435b-a6c8-7ce3bd94bc34 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b.bfdf6fb8-c88f-422e-ae8d-c2d7acccbb91 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:59 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b.bfdf6fb8-c88f-422e-ae8d-c2d7acccbb91 Nov 06 14:35:59 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:59 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48bbfd90-7808-4108-a3f4-41f0e726e768 1073741824" returned: 0 in 0.559s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48bbfd90-7808-4108-a3f4-41f0e726e768 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:35:59 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48bbfd90-7808-4108-a3f4-41f0e726e768 Nov 06 14:35:59 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:35:59 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-42e8c8b8-d5bd-435b-a6c8-7ce3bd94bc34 tempest-GroupSnapshotsTest-181620141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b.bfdf6fb8-c88f-422e-ae8d-c2d7acccbb91" returned: 0 in 0.388s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-42e8c8b8-d5bd-435b-a6c8-7ce3bd94bc34 tempest-GroupSnapshotsTest-181620141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af78f2a3-4c41-4218-ae9c-27c593b2151b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[1853b75f-a60e-4142-9457-c166fb4e93f1]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:35:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-42e8c8b8-d5bd-435b-a6c8-7ce3bd94bc34 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:00 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48bbfd90-7808-4108-a3f4-41f0e726e768" returned: 0 in 0.262s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.829s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1848883060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f57fb7e-cb91-49e8-aa72-9add6cc1bb0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2239425dfb8245918424b9b54be1db26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:35:56Z,use_quota=True,user_id='bf0ebdb483064dda8c2f47b3a91b4881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Creating volume 0f57fb7e-cb91-49e8-aa72-9add6cc1bb0e {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:36:00 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0f57fb7e-cb91-49e8-aa72-9add6cc1bb0e 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:00 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b Nov 06 14:36:00 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a6d132-a615-4f35-8c91-335e144909e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48bbfd90-7808-4108-a3f4-41f0e726e768', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:00 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0f57fb7e-cb91-49e8-aa72-9add6cc1bb0e 1073741824 Nov 06 14:36:00 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b57e646-d98d-4243-82dd-e65f57c03ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:00 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Volume volume-48bbfd90-7808-4108-a3f4-41f0e726e768 (48bbfd90-7808-4108-a3f4-41f0e726e768): created successfully Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b57e646-d98d-4243-82dd-e65f57c03ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Flow 'volume_create_manager' (41943d36-8ea5-46d0-b913-f81b27a67e57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:00 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-68aaf115-8b69-487e-a010-8122a53f24fa tempest-CreateVolumesFromSnapshotTest-808533590 None] Created volume successfully. Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6c76343d-4c57-4e48-a325-3e52b87ce3a2 tempest-TestMinimumBasicScenario-2070269532 None] Acquiring lock "cinder-da49ad45-99e2-4709-8d19-48a093d0a49c-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6c76343d-4c57-4e48-a325-3e52b87ce3a2 tempest-TestMinimumBasicScenario-2070269532 None] Lock "cinder-da49ad45-99e2-4709-8d19-48a093d0a49c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6c76343d-4c57-4e48-a325-3e52b87ce3a2 tempest-TestMinimumBasicScenario-2070269532 None] Acquiring lock "cinder-quobyte-da49ad45-99e2-4709-8d19-48a093d0a49c" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6c76343d-4c57-4e48-a325-3e52b87ce3a2 tempest-TestMinimumBasicScenario-2070269532 None] Lock "cinder-quobyte-da49ad45-99e2-4709-8d19-48a093d0a49c" acquired by "delete_volume" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[7560be3c-d0ea-4563-ad33-a40087e33c7e]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6c76343d-4c57-4e48-a325-3e52b87ce3a2 tempest-TestMinimumBasicScenario-2070269532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-da49ad45-99e2-4709-8d19-48a093d0a49c {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:00 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-42e8c8b8-d5bd-435b-a6c8-7ce3bd94bc34 tempest-GroupSnapshotsTest-181620141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b" returned: 0 in 0.461s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-42e8c8b8-d5bd-435b-a6c8-7ce3bd94bc34 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b.bfdf6fb8-c88f-422e-ae8d-c2d7acccbb91 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:00 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-da49ad45-99e2-4709-8d19-48a093d0a49c Nov 06 14:36:00 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:00 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b.bfdf6fb8-c88f-422e-ae8d-c2d7acccbb91 Nov 06 14:36:00 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:00 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0f57fb7e-cb91-49e8-aa72-9add6cc1bb0e 1073741824" returned: 0 in 0.468s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:00 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6c76343d-4c57-4e48-a325-3e52b87ce3a2 tempest-TestMinimumBasicScenario-2070269532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-da49ad45-99e2-4709-8d19-48a093d0a49c" returned: 0 in 0.374s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6c76343d-4c57-4e48-a325-3e52b87ce3a2 tempest-TestMinimumBasicScenario-2070269532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-da49ad45-99e2-4709-8d19-48a093d0a49c {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0f57fb7e-cb91-49e8-aa72-9add6cc1bb0e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:00 devstack sudo[98366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-da49ad45-99e2-4709-8d19-48a093d0a49c Nov 06 14:36:00 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:00 devstack sudo[98369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0f57fb7e-cb91-49e8-aa72-9add6cc1bb0e Nov 06 14:36:00 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:00 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-42e8c8b8-d5bd-435b-a6c8-7ce3bd94bc34 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b.bfdf6fb8-c88f-422e-ae8d-c2d7acccbb91" returned: 0 in 0.404s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-42e8c8b8-d5bd-435b-a6c8-7ce3bd94bc34 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b.bfdf6fb8-c88f-422e-ae8d-c2d7acccbb91 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:00 devstack sudo[98372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b.bfdf6fb8-c88f-422e-ae8d-c2d7acccbb91 Nov 06 14:36:00 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:00 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0f57fb7e-cb91-49e8-aa72-9add6cc1bb0e" returned: 0 in 0.269s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:00 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.262s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2146663801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78908b13-33ab-4805-a4bd-5875a7391b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2239425dfb8245918424b9b54be1db26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:35:57Z,use_quota=True,user_id='bf0ebdb483064dda8c2f47b3a91b4881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Creating volume 78908b13-33ab-4805-a4bd-5875a7391b20 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:36:00 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-78908b13-33ab-4805-a4bd-5875a7391b20 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6c76343d-4c57-4e48-a325-3e52b87ce3a2 tempest-TestMinimumBasicScenario-2070269532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-da49ad45-99e2-4709-8d19-48a093d0a49c" returned: 0 in 0.325s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:00 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-78908b13-33ab-4805-a4bd-5875a7391b20 1073741824 Nov 06 14:36:00 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (917c0b67-c001-4277-b3e0-fc83258eea10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f57fb7e-cb91-49e8-aa72-9add6cc1bb0e', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (772949b0-1b95-4121-a778-38cca495efd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6c76343d-4c57-4e48-a325-3e52b87ce3a2 tempest-TestMinimumBasicScenario-2070269532 None] Lock "cinder-quobyte-da49ad45-99e2-4709-8d19-48a093d0a49c" released by "delete_volume" :: held 0.764s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:01 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Volume volume-0f57fb7e-cb91-49e8-aa72-9add6cc1bb0e (0f57fb7e-cb91-49e8-aa72-9add6cc1bb0e): created successfully Nov 06 14:36:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (772949b0-1b95-4121-a778-38cca495efd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Flow 'volume_create_manager' (44edc09b-ccf2-4471-9f00-faca57621052) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:01 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-972eb559-d745-469d-a8ca-97258045e45c tempest-CreateVolumesFromSnapshotTest-808533590 None] Created volume successfully. Nov 06 14:36:01 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-42e8c8b8-d5bd-435b-a6c8-7ce3bd94bc34 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b.bfdf6fb8-c88f-422e-ae8d-c2d7acccbb91" returned: 0 in 0.308s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-42e8c8b8-d5bd-435b-a6c8-7ce3bd94bc34 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-bfdf6fb8-c88f-422e-ae8d-c2d7acccbb91" released by "_delete_snapshot" :: held 1.703s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-42e8c8b8-d5bd-435b-a6c8-7ce3bd94bc34 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-af78f2a3-4c41-4218-ae9c-27c593b2151b" released by "delete_snapshot" :: held 1.738s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:01 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-6c76343d-4c57-4e48-a325-3e52b87ce3a2 tempest-TestMinimumBasicScenario-2070269532 None] Created reservations ['9962c0ac-4866-4571-b61b-6a9d8c787357', 'cbce8662-8ed6-4174-9032-c0e8cbaedb7c', '384405c5-8aa0-456e-949e-4ca868626030', 'bcb9a22b-6c33-4e3f-9892-4662882f3e82'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6c76343d-4c57-4e48-a325-3e52b87ce3a2 tempest-TestMinimumBasicScenario-2070269532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6c76343d-4c57-4e48-a325-3e52b87ce3a2 tempest-TestMinimumBasicScenario-2070269532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:01 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6c76343d-4c57-4e48-a325-3e52b87ce3a2 tempest-TestMinimumBasicScenario-2070269532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:01 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6c76343d-4c57-4e48-a325-3e52b87ce3a2 tempest-TestMinimumBasicScenario-2070269532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6c76343d-4c57-4e48-a325-3e52b87ce3a2 tempest-TestMinimumBasicScenario-2070269532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6c76343d-4c57-4e48-a325-3e52b87ce3a2 tempest-TestMinimumBasicScenario-2070269532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:01 devstack cinder-volume[86854]: WARNING cinder.quota [None req-42e8c8b8-d5bd-435b-a6c8-7ce3bd94bc34 tempest-GroupSnapshotsTest-181620141 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-303986190 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-303986190, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:36:01 devstack cinder-volume[86854]: WARNING cinder.quota [None req-42e8c8b8-d5bd-435b-a6c8-7ce3bd94bc34 tempest-GroupSnapshotsTest-181620141 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-303986190 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-303986190, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:36:01 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:36:01 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:01 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-42e8c8b8-d5bd-435b-a6c8-7ce3bd94bc34 tempest-GroupSnapshotsTest-181620141 None] Created reservations ['e110a2ee-5d7c-4807-b871-91c0fd682b84', '0a27dc23-0062-483c-a3da-7ea4233d51c4', 'b99fed0c-a023-4e19-99d0-9b4eb532924a', 'cacabeb2-7b97-4c8b-a6f9-90dfb2047fdd'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:01 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-42e8c8b8-d5bd-435b-a6c8-7ce3bd94bc34 tempest-GroupSnapshotsTest-181620141 None] group_snapshot 408a983a-8805-4622-875b-2eab54d19ced: deleted successfully Nov 06 14:36:01 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-78908b13-33ab-4805-a4bd-5875a7391b20 1073741824" returned: 0 in 0.586s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:01 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-78908b13-33ab-4805-a4bd-5875a7391b20 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6c76343d-4c57-4e48-a325-3e52b87ce3a2 tempest-TestMinimumBasicScenario-2070269532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.376s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:01 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-6c76343d-4c57-4e48-a325-3e52b87ce3a2 tempest-TestMinimumBasicScenario-2070269532 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:36:01 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-6c76343d-4c57-4e48-a325-3e52b87ce3a2 tempest-TestMinimumBasicScenario-2070269532 None] Deleted volume successfully. Nov 06 14:36:01 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-78908b13-33ab-4805-a4bd-5875a7391b20 Nov 06 14:36:01 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6c76343d-4c57-4e48-a325-3e52b87ce3a2 tempest-TestMinimumBasicScenario-2070269532 None] Lock "cinder-da49ad45-99e2-4709-8d19-48a093d0a49c-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:01 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-78908b13-33ab-4805-a4bd-5875a7391b20" returned: 0 in 0.325s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:01 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:36:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738101c2-d575-4a96-94fa-f18923a7e8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78908b13-33ab-4805-a4bd-5875a7391b20', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dcb3aa3-0b80-442b-ada0-cab8ae29e597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:02 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Volume volume-78908b13-33ab-4805-a4bd-5875a7391b20 (78908b13-33ab-4805-a4bd-5875a7391b20): created successfully Nov 06 14:36:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dcb3aa3-0b80-442b-ada0-cab8ae29e597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Flow 'volume_create_manager' (3137cbf0-1360-4bb6-b302-c2d5f91bf4c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:02 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-a09dc838-a69a-439d-9522-3aac91c85ed4 tempest-CreateVolumesFromSnapshotTest-808533590 None] Created volume successfully. Nov 06 14:36:02 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1c4536c4-65c3-4bf4-8460-767cd7a1f9a0 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "cinder-quobyte-af78f2a3-4c41-4218-ae9c-27c593b2151b" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:02 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1c4536c4-65c3-4bf4-8460-767cd7a1f9a0 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-af78f2a3-4c41-4218-ae9c-27c593b2151b" acquired by "delete_volume" :: waited 0.026s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:02 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c61f02-e505-4094-a3fe-d4450c12b08a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1c4536c4-65c3-4bf4-8460-767cd7a1f9a0 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:02 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b Nov 06 14:36:02 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:02 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1c4536c4-65c3-4bf4-8460-767cd7a1f9a0 tempest-GroupSnapshotsTest-181620141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b" returned: 0 in 0.472s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1c4536c4-65c3-4bf4-8460-767cd7a1f9a0 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:02 devstack sudo[98416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b Nov 06 14:36:02 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:03 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1c4536c4-65c3-4bf4-8460-767cd7a1f9a0 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-af78f2a3-4c41-4218-ae9c-27c593b2151b" returned: 0 in 0.461s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:03 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1c4536c4-65c3-4bf4-8460-767cd7a1f9a0 tempest-GroupSnapshotsTest-181620141 None] Lock "cinder-quobyte-af78f2a3-4c41-4218-ae9c-27c593b2151b" released by "delete_volume" :: held 1.041s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:03 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d7755d43-1c26-4b52-bcd7-3cf39c0db65d tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "cinder-78908b13-33ab-4805-a4bd-5875a7391b20-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:03 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d7755d43-1c26-4b52-bcd7-3cf39c0db65d tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-78908b13-33ab-4805-a4bd-5875a7391b20-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:03 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d7755d43-1c26-4b52-bcd7-3cf39c0db65d tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "cinder-quobyte-78908b13-33ab-4805-a4bd-5875a7391b20" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:03 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d7755d43-1c26-4b52-bcd7-3cf39c0db65d tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-quobyte-78908b13-33ab-4805-a4bd-5875a7391b20" acquired by "delete_volume" :: waited 0.034s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:03 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-1c4536c4-65c3-4bf4-8460-767cd7a1f9a0 tempest-GroupSnapshotsTest-181620141 None] Created reservations ['87457eef-09dc-4147-8c8c-e061b65bdfee'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:03 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[7152dd22-87f2-43ca-8c24-c616820905ad]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d7755d43-1c26-4b52-bcd7-3cf39c0db65d tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-78908b13-33ab-4805-a4bd-5875a7391b20 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:03 devstack cinder-volume[86854]: WARNING cinder.quota [None req-1c4536c4-65c3-4bf4-8460-767cd7a1f9a0 tempest-GroupSnapshotsTest-181620141 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-303986190 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-303986190, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:36:03 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-1c4536c4-65c3-4bf4-8460-767cd7a1f9a0 tempest-GroupSnapshotsTest-181620141 None] Created reservations ['257174fa-0174-4a08-a3f5-6df95ab04307', '38da595d-1c7a-416f-90d3-f6c8a5d53f98', '3ece25f3-1523-4f36-a45f-c3121e2d44bf', 'f83d19d7-03ec-4bd9-8e5d-0e7343e4db3f'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:03 devstack sudo[98421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-78908b13-33ab-4805-a4bd-5875a7391b20 Nov 06 14:36:03 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1c4536c4-65c3-4bf4-8460-767cd7a1f9a0 tempest-GroupSnapshotsTest-181620141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1c4536c4-65c3-4bf4-8460-767cd7a1f9a0 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:03 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1c4536c4-65c3-4bf4-8460-767cd7a1f9a0 tempest-GroupSnapshotsTest-181620141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:03 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1c4536c4-65c3-4bf4-8460-767cd7a1f9a0 tempest-GroupSnapshotsTest-181620141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1c4536c4-65c3-4bf4-8460-767cd7a1f9a0 tempest-GroupSnapshotsTest-181620141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1c4536c4-65c3-4bf4-8460-767cd7a1f9a0 tempest-GroupSnapshotsTest-181620141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:03 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:36:03 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:04 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d7755d43-1c26-4b52-bcd7-3cf39c0db65d tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-78908b13-33ab-4805-a4bd-5875a7391b20" returned: 0 in 0.482s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d7755d43-1c26-4b52-bcd7-3cf39c0db65d tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-78908b13-33ab-4805-a4bd-5875a7391b20 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:04 devstack sudo[98430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-78908b13-33ab-4805-a4bd-5875a7391b20 Nov 06 14:36:04 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:04 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1c4536c4-65c3-4bf4-8460-767cd7a1f9a0 tempest-GroupSnapshotsTest-181620141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.296s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:04 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-1c4536c4-65c3-4bf4-8460-767cd7a1f9a0 tempest-GroupSnapshotsTest-181620141 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:36:04 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-1c4536c4-65c3-4bf4-8460-767cd7a1f9a0 tempest-GroupSnapshotsTest-181620141 None] Delete group completed successfully. Nov 06 14:36:04 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d7755d43-1c26-4b52-bcd7-3cf39c0db65d tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-78908b13-33ab-4805-a4bd-5875a7391b20" returned: 0 in 0.271s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:04 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d7755d43-1c26-4b52-bcd7-3cf39c0db65d tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-quobyte-78908b13-33ab-4805-a4bd-5875a7391b20" released by "delete_volume" :: held 0.815s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:04 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-d7755d43-1c26-4b52-bcd7-3cf39c0db65d tempest-CreateVolumesFromSnapshotTest-808533590 None] Created reservations ['1f0646c1-7afe-4e00-b704-1745a5490cb6', '8794e9a1-7b4c-4044-9d25-8011b9a421f5', '17c5d518-ba29-4ce6-b4fd-a410ca70a142', '288308f0-58f5-4fe4-9e47-b77289da9310'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d7755d43-1c26-4b52-bcd7-3cf39c0db65d tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d7755d43-1c26-4b52-bcd7-3cf39c0db65d tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:04 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d7755d43-1c26-4b52-bcd7-3cf39c0db65d tempest-CreateVolumesFromSnapshotTest-808533590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:04 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d7755d43-1c26-4b52-bcd7-3cf39c0db65d tempest-CreateVolumesFromSnapshotTest-808533590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d7755d43-1c26-4b52-bcd7-3cf39c0db65d tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d7755d43-1c26-4b52-bcd7-3cf39c0db65d tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:04 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:36:04 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:04 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-71369156-060e-4809-b7a4-838e0d96ef08 tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "cinder-0f57fb7e-cb91-49e8-aa72-9add6cc1bb0e-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:04 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-71369156-060e-4809-b7a4-838e0d96ef08 tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-0f57fb7e-cb91-49e8-aa72-9add6cc1bb0e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:04 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-71369156-060e-4809-b7a4-838e0d96ef08 tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "cinder-quobyte-0f57fb7e-cb91-49e8-aa72-9add6cc1bb0e" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:04 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d7755d43-1c26-4b52-bcd7-3cf39c0db65d tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.372s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:04 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-d7755d43-1c26-4b52-bcd7-3cf39c0db65d tempest-CreateVolumesFromSnapshotTest-808533590 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:36:04 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-d7755d43-1c26-4b52-bcd7-3cf39c0db65d tempest-CreateVolumesFromSnapshotTest-808533590 None] Deleted volume successfully. Nov 06 14:36:04 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-71369156-060e-4809-b7a4-838e0d96ef08 tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-quobyte-0f57fb7e-cb91-49e8-aa72-9add6cc1bb0e" acquired by "delete_volume" :: waited 0.034s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:04 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d7755d43-1c26-4b52-bcd7-3cf39c0db65d tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-78908b13-33ab-4805-a4bd-5875a7391b20-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:04 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[0104ae68-f83d-494c-8431-dc4fb764879a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-71369156-060e-4809-b7a4-838e0d96ef08 tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0f57fb7e-cb91-49e8-aa72-9add6cc1bb0e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:05 devstack sudo[98436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0f57fb7e-cb91-49e8-aa72-9add6cc1bb0e Nov 06 14:36:05 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:05 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-71369156-060e-4809-b7a4-838e0d96ef08 tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0f57fb7e-cb91-49e8-aa72-9add6cc1bb0e" returned: 0 in 0.429s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-71369156-060e-4809-b7a4-838e0d96ef08 tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0f57fb7e-cb91-49e8-aa72-9add6cc1bb0e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:05 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0f57fb7e-cb91-49e8-aa72-9add6cc1bb0e Nov 06 14:36:05 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:05 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-71369156-060e-4809-b7a4-838e0d96ef08 tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0f57fb7e-cb91-49e8-aa72-9add6cc1bb0e" returned: 0 in 0.319s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:05 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-71369156-060e-4809-b7a4-838e0d96ef08 tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-quobyte-0f57fb7e-cb91-49e8-aa72-9add6cc1bb0e" released by "delete_volume" :: held 0.820s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:05 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-71369156-060e-4809-b7a4-838e0d96ef08 tempest-CreateVolumesFromSnapshotTest-808533590 None] Created reservations ['113350d8-83c2-4f74-8b21-5c2ef94a6888', 'a13b3e2f-5f41-4209-8478-f7bb4bb5269e', '1a93871c-0901-43af-93aa-e1ff7becaf18', '50505b78-48d1-439a-8241-2678c2bfc42a'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-71369156-060e-4809-b7a4-838e0d96ef08 tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-71369156-060e-4809-b7a4-838e0d96ef08 tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-71369156-060e-4809-b7a4-838e0d96ef08 tempest-CreateVolumesFromSnapshotTest-808533590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-71369156-060e-4809-b7a4-838e0d96ef08 tempest-CreateVolumesFromSnapshotTest-808533590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-71369156-060e-4809-b7a4-838e0d96ef08 tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-71369156-060e-4809-b7a4-838e0d96ef08 tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:05 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:36:05 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:05 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ef1f1cec-b3f9-43b8-8eda-19c4e7d9180c tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "cinder-48bbfd90-7808-4108-a3f4-41f0e726e768-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:05 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ef1f1cec-b3f9-43b8-8eda-19c4e7d9180c tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-48bbfd90-7808-4108-a3f4-41f0e726e768-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:06 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ef1f1cec-b3f9-43b8-8eda-19c4e7d9180c tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "cinder-quobyte-48bbfd90-7808-4108-a3f4-41f0e726e768" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:06 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ef1f1cec-b3f9-43b8-8eda-19c4e7d9180c tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-quobyte-48bbfd90-7808-4108-a3f4-41f0e726e768" acquired by "delete_volume" :: waited 0.016s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:06 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:06 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e2809a-a693-4f15-80a4-c8779659a0f6]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ef1f1cec-b3f9-43b8-8eda-19c4e7d9180c tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48bbfd90-7808-4108-a3f4-41f0e726e768 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-71369156-060e-4809-b7a4-838e0d96ef08 tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.317s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:06 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-71369156-060e-4809-b7a4-838e0d96ef08 tempest-CreateVolumesFromSnapshotTest-808533590 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:36:06 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-71369156-060e-4809-b7a4-838e0d96ef08 tempest-CreateVolumesFromSnapshotTest-808533590 None] Deleted volume successfully. Nov 06 14:36:06 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-71369156-060e-4809-b7a4-838e0d96ef08 tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-0f57fb7e-cb91-49e8-aa72-9add6cc1bb0e-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:06 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48bbfd90-7808-4108-a3f4-41f0e726e768 Nov 06 14:36:06 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:06 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ef1f1cec-b3f9-43b8-8eda-19c4e7d9180c tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48bbfd90-7808-4108-a3f4-41f0e726e768" returned: 0 in 0.496s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ef1f1cec-b3f9-43b8-8eda-19c4e7d9180c tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48bbfd90-7808-4108-a3f4-41f0e726e768 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:06 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48bbfd90-7808-4108-a3f4-41f0e726e768 Nov 06 14:36:06 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:06 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ef1f1cec-b3f9-43b8-8eda-19c4e7d9180c tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48bbfd90-7808-4108-a3f4-41f0e726e768" returned: 0 in 0.325s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:06 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ef1f1cec-b3f9-43b8-8eda-19c4e7d9180c tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-quobyte-48bbfd90-7808-4108-a3f4-41f0e726e768" released by "delete_volume" :: held 0.892s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-ef1f1cec-b3f9-43b8-8eda-19c4e7d9180c tempest-CreateVolumesFromSnapshotTest-808533590 None] Created reservations ['66ba6cdb-4dd3-4799-9450-728faf0f0d10', '653dbdff-f633-41f3-ac99-d9a146981a7b', 'b1fb04c9-69a6-4e55-ad9a-4b9c7ebf479d', 'cc9244af-0503-403b-8a78-b1d20a2f075f'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ef1f1cec-b3f9-43b8-8eda-19c4e7d9180c tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ef1f1cec-b3f9-43b8-8eda-19c4e7d9180c tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ef1f1cec-b3f9-43b8-8eda-19c4e7d9180c tempest-CreateVolumesFromSnapshotTest-808533590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ef1f1cec-b3f9-43b8-8eda-19c4e7d9180c tempest-CreateVolumesFromSnapshotTest-808533590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ef1f1cec-b3f9-43b8-8eda-19c4e7d9180c tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ef1f1cec-b3f9-43b8-8eda-19c4e7d9180c tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:07 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:36:07 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-20a8e7ff-07d8-4ebd-a2f2-71a4a3a8b04d tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "cinder-c98d3c08-0cd7-4a19-8939-ea7758b32ef4-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-20a8e7ff-07d8-4ebd-a2f2-71a4a3a8b04d tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-c98d3c08-0cd7-4a19-8939-ea7758b32ef4-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-20a8e7ff-07d8-4ebd-a2f2-71a4a3a8b04d tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "cinder-quobyte-c98d3c08-0cd7-4a19-8939-ea7758b32ef4" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-20a8e7ff-07d8-4ebd-a2f2-71a4a3a8b04d tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-quobyte-c98d3c08-0cd7-4a19-8939-ea7758b32ef4" acquired by "delete_volume" :: waited 0.028s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[329223bc-3fc9-481d-b369-c2e0115a39a9]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-20a8e7ff-07d8-4ebd-a2f2-71a4a3a8b04d tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c98d3c08-0cd7-4a19-8939-ea7758b32ef4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Flow 'volume_create_manager' (ba52f6ac-6a66-4ae8-83c7-342c3ab57b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c61f35-7cf6-44bf-90db-c1b0d5fa4a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:07 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ef1f1cec-b3f9-43b8-8eda-19c4e7d9180c tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.420s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-ef1f1cec-b3f9-43b8-8eda-19c4e7d9180c tempest-CreateVolumesFromSnapshotTest-808533590 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:36:07 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-ef1f1cec-b3f9-43b8-8eda-19c4e7d9180c tempest-CreateVolumesFromSnapshotTest-808533590 None] Deleted volume successfully. Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c61f35-7cf6-44bf-90db-c1b0d5fa4a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-722065932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b37d4ffa-15ab-450a-ad11-1defde82daf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9af60c62844347dfbe5727070c2111cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:08Z,use_quota=True,user_id='2ef393ee75d1408caceda02b6b9e8f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:07 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c98d3c08-0cd7-4a19-8939-ea7758b32ef4 Nov 06 14:36:07 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c556cf-b90a-4311-9f4d-3700f6fa76b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c556cf-b90a-4311-9f4d-3700f6fa76b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1025266-0802-4073-a6de-407270b42a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1025266-0802-4073-a6de-407270b42a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b37d4ffa-15ab-450a-ad11-1defde82daf4', 'volume_name': 'volume-b37d4ffa-15ab-450a-ad11-1defde82daf4', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57c6c9f-5c08-4652-8b65-29c7e852601d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57c6c9f-5c08-4652-8b65-29c7e852601d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b93241d-fb7c-426b-9c01-8a9560d3aa0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:07 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Volume b37d4ffa-15ab-450a-ad11-1defde82daf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b37d4ffa-15ab-450a-ad11-1defde82daf4', 'volume_size': 1} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-722065932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b37d4ffa-15ab-450a-ad11-1defde82daf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9af60c62844347dfbe5727070c2111cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:08Z,use_quota=True,user_id='2ef393ee75d1408caceda02b6b9e8f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Creating volume b37d4ffa-15ab-450a-ad11-1defde82daf4 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:36:07 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b37d4ffa-15ab-450a-ad11-1defde82daf4 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:07 devstack sudo[98506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b37d4ffa-15ab-450a-ad11-1defde82daf4 1073741824 Nov 06 14:36:07 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ef1f1cec-b3f9-43b8-8eda-19c4e7d9180c tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-48bbfd90-7808-4108-a3f4-41f0e726e768-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:07 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:08 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-20a8e7ff-07d8-4ebd-a2f2-71a4a3a8b04d tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c98d3c08-0cd7-4a19-8939-ea7758b32ef4" returned: 0 in 0.504s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-20a8e7ff-07d8-4ebd-a2f2-71a4a3a8b04d tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c98d3c08-0cd7-4a19-8939-ea7758b32ef4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:08 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c98d3c08-0cd7-4a19-8939-ea7758b32ef4 Nov 06 14:36:08 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:08 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-20a8e7ff-07d8-4ebd-a2f2-71a4a3a8b04d tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c98d3c08-0cd7-4a19-8939-ea7758b32ef4" returned: 0 in 0.299s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:08 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:08 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-20a8e7ff-07d8-4ebd-a2f2-71a4a3a8b04d tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-quobyte-c98d3c08-0cd7-4a19-8939-ea7758b32ef4" released by "delete_volume" :: held 0.863s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b37d4ffa-15ab-450a-ad11-1defde82daf4 1073741824" returned: 0 in 0.614s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b37d4ffa-15ab-450a-ad11-1defde82daf4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:08 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b37d4ffa-15ab-450a-ad11-1defde82daf4 Nov 06 14:36:08 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:08 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-20a8e7ff-07d8-4ebd-a2f2-71a4a3a8b04d tempest-CreateVolumesFromSnapshotTest-808533590 None] Created reservations ['e89d5f86-a2f9-4796-8e80-59c1159fbb90', '97d80777-e657-44e3-93e6-e356ce78e5c9', '041bbd86-1ccd-4095-b56c-218386fac1c2', 'e4c6ca92-ca5e-4e64-a184-7e7c7f755907'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-20a8e7ff-07d8-4ebd-a2f2-71a4a3a8b04d tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-20a8e7ff-07d8-4ebd-a2f2-71a4a3a8b04d tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:08 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-20a8e7ff-07d8-4ebd-a2f2-71a4a3a8b04d tempest-CreateVolumesFromSnapshotTest-808533590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:08 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-20a8e7ff-07d8-4ebd-a2f2-71a4a3a8b04d tempest-CreateVolumesFromSnapshotTest-808533590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-20a8e7ff-07d8-4ebd-a2f2-71a4a3a8b04d tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-20a8e7ff-07d8-4ebd-a2f2-71a4a3a8b04d tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:08 devstack sudo[98520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:36:08 devstack sudo[98520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:08 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b37d4ffa-15ab-450a-ad11-1defde82daf4" returned: 0 in 0.270s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:08 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:36:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b93241d-fb7c-426b-9c01-8a9560d3aa0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b37d4ffa-15ab-450a-ad11-1defde82daf4', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dbcb418-343e-42ca-989f-f09eaa2799b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:08 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Volume volume-b37d4ffa-15ab-450a-ad11-1defde82daf4 (b37d4ffa-15ab-450a-ad11-1defde82daf4): created successfully Nov 06 14:36:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dbcb418-343e-42ca-989f-f09eaa2799b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Flow 'volume_create_manager' (ba52f6ac-6a66-4ae8-83c7-342c3ab57b2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:08 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-d832799f-4ff7-4b57-9a87-bc1c5f5b3df2 tempest-AttachVolumeNegativeTest-1303646863 None] Created volume successfully. Nov 06 14:36:08 devstack sudo[98520]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-20a8e7ff-07d8-4ebd-a2f2-71a4a3a8b04d tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.291s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:08 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-20a8e7ff-07d8-4ebd-a2f2-71a4a3a8b04d tempest-CreateVolumesFromSnapshotTest-808533590 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:36:08 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-20a8e7ff-07d8-4ebd-a2f2-71a4a3a8b04d tempest-CreateVolumesFromSnapshotTest-808533590 None] Deleted volume successfully. Nov 06 14:36:08 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-20a8e7ff-07d8-4ebd-a2f2-71a4a3a8b04d tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-c98d3c08-0cd7-4a19-8939-ea7758b32ef4-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8922ce7e-2203-453f-85d0-a279d34a2c49 tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "cinder-7f08c382-8993-4f27-a3ef-591f4005f70b-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8922ce7e-2203-453f-85d0-a279d34a2c49 tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-7f08c382-8993-4f27-a3ef-591f4005f70b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8922ce7e-2203-453f-85d0-a279d34a2c49 tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "cinder-quobyte-7f08c382-8993-4f27-a3ef-591f4005f70b" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8922ce7e-2203-453f-85d0-a279d34a2c49 tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-quobyte-7f08c382-8993-4f27-a3ef-591f4005f70b" acquired by "delete_volume" :: waited 0.024s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:09 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[67297e2a-70f5-4741-baff-31952f513a8b]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8922ce7e-2203-453f-85d0-a279d34a2c49 tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7f08c382-8993-4f27-a3ef-591f4005f70b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:09 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7f08c382-8993-4f27-a3ef-591f4005f70b Nov 06 14:36:09 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:10 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8922ce7e-2203-453f-85d0-a279d34a2c49 tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7f08c382-8993-4f27-a3ef-591f4005f70b" returned: 0 in 0.636s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8922ce7e-2203-453f-85d0-a279d34a2c49 tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7f08c382-8993-4f27-a3ef-591f4005f70b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:10 devstack sudo[98538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7f08c382-8993-4f27-a3ef-591f4005f70b Nov 06 14:36:10 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-89312b0a-4bf6-4383-aa11-dc0c63cd57b0 req-e009b328-3a0d-488b-bef8-be647499cc90 tempest-AttachVolumeNegativeTest-1303646863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-89312b0a-4bf6-4383-aa11-dc0c63cd57b0 req-e009b328-3a0d-488b-bef8-be647499cc90 tempest-AttachVolumeNegativeTest-1303646863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-89312b0a-4bf6-4383-aa11-dc0c63cd57b0 req-e009b328-3a0d-488b-bef8-be647499cc90 tempest-AttachVolumeNegativeTest-1303646863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:10 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8922ce7e-2203-453f-85d0-a279d34a2c49 tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7f08c382-8993-4f27-a3ef-591f4005f70b" returned: 0 in 0.323s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-89312b0a-4bf6-4383-aa11-dc0c63cd57b0 req-e009b328-3a0d-488b-bef8-be647499cc90 tempest-AttachVolumeNegativeTest-1303646863 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e', 'name': 'volume-b37d4ffa-15ab-450a-ad11-1defde82daf4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f3434e1-fcc5-4110-ae87-16ec78ffbb9b', 'enforce_multipath': True} {{(pid=86854) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 14:36:10 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8922ce7e-2203-453f-85d0-a279d34a2c49 tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-quobyte-7f08c382-8993-4f27-a3ef-591f4005f70b" released by "delete_volume" :: held 1.043s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:10 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-89312b0a-4bf6-4383-aa11-dc0c63cd57b0 req-e009b328-3a0d-488b-bef8-be647499cc90 tempest-AttachVolumeNegativeTest-1303646863 None] attachment_update completed successfully. Nov 06 14:36:10 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-8922ce7e-2203-453f-85d0-a279d34a2c49 tempest-CreateVolumesFromSnapshotTest-808533590 None] Created reservations ['3d9f72b4-d9f9-47a8-bb10-9c60f02adbaf', '2c7e43d2-9f36-44ea-b4d5-424265b8dd7f', '985e8575-eac9-4f00-9a14-a4039cbeb68a', '04714051-144a-4b36-b799-d2598c8a32fa'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8922ce7e-2203-453f-85d0-a279d34a2c49 tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8922ce7e-2203-453f-85d0-a279d34a2c49 tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:10 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8922ce7e-2203-453f-85d0-a279d34a2c49 tempest-CreateVolumesFromSnapshotTest-808533590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:10 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8922ce7e-2203-453f-85d0-a279d34a2c49 tempest-CreateVolumesFromSnapshotTest-808533590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8922ce7e-2203-453f-85d0-a279d34a2c49 tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8922ce7e-2203-453f-85d0-a279d34a2c49 tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:10 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:36:10 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:11 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8922ce7e-2203-453f-85d0-a279d34a2c49 tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.294s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:11 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-8922ce7e-2203-453f-85d0-a279d34a2c49 tempest-CreateVolumesFromSnapshotTest-808533590 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:36:11 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-8922ce7e-2203-453f-85d0-a279d34a2c49 tempest-CreateVolumesFromSnapshotTest-808533590 None] Deleted volume successfully. Nov 06 14:36:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8922ce7e-2203-453f-85d0-a279d34a2c49 tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-7f08c382-8993-4f27-a3ef-591f4005f70b-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a91491c6-88ff-4f52-aeb4-6cca1216133a tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "cinder-239f3a52-cf0d-4a34-9894-5ff4e4b405cf-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a91491c6-88ff-4f52-aeb4-6cca1216133a tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-239f3a52-cf0d-4a34-9894-5ff4e4b405cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a91491c6-88ff-4f52-aeb4-6cca1216133a tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "cinder-quobyte-9f989ee6-167e-4d29-9394-ceb179dae2aa" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a91491c6-88ff-4f52-aeb4-6cca1216133a tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-quobyte-9f989ee6-167e-4d29-9394-ceb179dae2aa" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a91491c6-88ff-4f52-aeb4-6cca1216133a tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "cinder-quobyte-239f3a52-cf0d-4a34-9894-5ff4e4b405cf" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a91491c6-88ff-4f52-aeb4-6cca1216133a tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-quobyte-239f3a52-cf0d-4a34-9894-5ff4e4b405cf" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:11 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-a91491c6-88ff-4f52-aeb4-6cca1216133a tempest-CreateVolumesFromSnapshotTest-808533590 None] Deleting offline snapshot 239f3a52-cf0d-4a34-9894-5ff4e4b405cf of volume 9f989ee6-167e-4d29-9394-ceb179dae2aa {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:36:12 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-a91491c6-88ff-4f52-aeb4-6cca1216133a tempest-CreateVolumesFromSnapshotTest-808533590 None] snapshot_file for this snap is: volume-9f989ee6-167e-4d29-9394-ceb179dae2aa.239f3a52-cf0d-4a34-9894-5ff4e4b405cf {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:36:12 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[15aa3099-b229-49ce-b9ff-088fd6770dcf]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a91491c6-88ff-4f52-aeb4-6cca1216133a tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa.239f3a52-cf0d-4a34-9894-5ff4e4b405cf {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:12 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa.239f3a52-cf0d-4a34-9894-5ff4e4b405cf Nov 06 14:36:12 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:12 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a91491c6-88ff-4f52-aeb4-6cca1216133a tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa.239f3a52-cf0d-4a34-9894-5ff4e4b405cf" returned: 0 in 0.479s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:12 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-a91491c6-88ff-4f52-aeb4-6cca1216133a tempest-CreateVolumesFromSnapshotTest-808533590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f989ee6-167e-4d29-9394-ceb179dae2aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:36:12 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6a2fb9-8836-4c11-b9f5-dad9a546adeb]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a91491c6-88ff-4f52-aeb4-6cca1216133a tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:12 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa Nov 06 14:36:12 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:36:13 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Flow 'volume_create_manager' (3c56f82a-5b7d-410e-b992-f99a7423118e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a4cf33f-4d77-4afa-9417-e891da006c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a91491c6-88ff-4f52-aeb4-6cca1216133a tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa" returned: 0 in 0.507s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a91491c6-88ff-4f52-aeb4-6cca1216133a tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa.239f3a52-cf0d-4a34-9894-5ff4e4b405cf {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:13 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa.239f3a52-cf0d-4a34-9894-5ff4e4b405cf Nov 06 14:36:13 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a4cf33f-4d77-4afa-9417-e891da006c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-883850776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982ec8aa-fbfc-4c99-b131-d0e27779b154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7470779b594df793aa9166a46b61d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:13Z,use_quota=True,user_id='20379547550b4e6aa49663a1c5c47e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08ec2323-8e69-4af5-9381-96894bbd23f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08ec2323-8e69-4af5-9381-96894bbd23f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf143d73-ad5d-48d3-ab64-cd22c46e23de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf143d73-ad5d-48d3-ab64-cd22c46e23de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '982ec8aa-fbfc-4c99-b131-d0e27779b154', 'volume_name': 'volume-982ec8aa-fbfc-4c99-b131-d0e27779b154', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2544a067-2d10-44c7-8547-b68ad13f1a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2544a067-2d10-44c7-8547-b68ad13f1a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04003ee3-59cd-4c02-879e-f4789a6ac7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:13 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Volume 982ec8aa-fbfc-4c99-b131-d0e27779b154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-982ec8aa-fbfc-4c99-b131-d0e27779b154', 'volume_size': 1} Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-883850776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982ec8aa-fbfc-4c99-b131-d0e27779b154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7470779b594df793aa9166a46b61d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:13Z,use_quota=True,user_id='20379547550b4e6aa49663a1c5c47e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Creating volume 982ec8aa-fbfc-4c99-b131-d0e27779b154 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:36:13 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:13 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154 1073741824 Nov 06 14:36:13 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:13 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a91491c6-88ff-4f52-aeb4-6cca1216133a tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa.239f3a52-cf0d-4a34-9894-5ff4e4b405cf" returned: 0 in 0.594s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a91491c6-88ff-4f52-aeb4-6cca1216133a tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa.239f3a52-cf0d-4a34-9894-5ff4e4b405cf {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:13 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-dce9ccbe-e341-44c5-b8c5-271bb8b5a58e req-3c05d3bc-c881-48ae-80f1-2b8d275756b7 tempest-AttachVolumeNegativeTest-1303646863 None] Terminate volume connection completed successfully. Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-dce9ccbe-e341-44c5-b8c5-271bb8b5a58e req-3c05d3bc-c881-48ae-80f1-2b8d275756b7 tempest-AttachVolumeNegativeTest-1303646863 None] Deleting attachment 4f3434e1-fcc5-4110-ae87-16ec78ffbb9b. {{(pid=86854) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 14:36:13 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa.239f3a52-cf0d-4a34-9894-5ff4e4b405cf Nov 06 14:36:13 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:13 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154 1073741824" returned: 0 in 0.637s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:13 devstack sudo[99023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154 Nov 06 14:36:13 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:14 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a91491c6-88ff-4f52-aeb4-6cca1216133a tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa.239f3a52-cf0d-4a34-9894-5ff4e4b405cf" returned: 0 in 0.441s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:14 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a91491c6-88ff-4f52-aeb4-6cca1216133a tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-quobyte-239f3a52-cf0d-4a34-9894-5ff4e4b405cf" released by "_delete_snapshot" :: held 2.175s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:14 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a91491c6-88ff-4f52-aeb4-6cca1216133a tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-quobyte-9f989ee6-167e-4d29-9394-ceb179dae2aa" released by "delete_snapshot" :: held 2.204s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:14 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-a91491c6-88ff-4f52-aeb4-6cca1216133a tempest-CreateVolumesFromSnapshotTest-808533590 None] Created reservations ['0dea0507-cfa4-4ec4-adbf-d090c57d2bb8', 'd06530f3-9f02-498e-a816-33de1fe2ff44', '465eda15-c937-47db-b525-519ed2c16ecd', 'aa60e02e-9622-4e99-8958-8c3b05abd428'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:14 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154" returned: 0 in 0.357s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:36:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04003ee3-59cd-4c02-879e-f4789a6ac7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-982ec8aa-fbfc-4c99-b131-d0e27779b154', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1285fb23-d0be-4705-a985-5a30275d69da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:14 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Volume volume-982ec8aa-fbfc-4c99-b131-d0e27779b154 (982ec8aa-fbfc-4c99-b131-d0e27779b154): created successfully Nov 06 14:36:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1285fb23-d0be-4705-a985-5a30275d69da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Flow 'volume_create_manager' (3c56f82a-5b7d-410e-b992-f99a7423118e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:14 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-035ed1bf-2bc9-475d-9e2f-e1c50345d38b tempest-SnapshotsActionsTest-975319395 None] Created volume successfully. Nov 06 14:36:14 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-a91491c6-88ff-4f52-aeb4-6cca1216133a tempest-CreateVolumesFromSnapshotTest-808533590 None] Delete snapshot completed successfully. Nov 06 14:36:14 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a91491c6-88ff-4f52-aeb4-6cca1216133a tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-239f3a52-cf0d-4a34-9894-5ff4e4b405cf-delete_snapshot" released by "delete_snapshot" :: held 2.421s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:15 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b1a0ccc4-7203-4836-8cbc-f68254949ace tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "cinder-9f989ee6-167e-4d29-9394-ceb179dae2aa-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:15 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b1a0ccc4-7203-4836-8cbc-f68254949ace tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-9f989ee6-167e-4d29-9394-ceb179dae2aa-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:15 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b1a0ccc4-7203-4836-8cbc-f68254949ace tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "cinder-quobyte-9f989ee6-167e-4d29-9394-ceb179dae2aa" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:15 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b1a0ccc4-7203-4836-8cbc-f68254949ace tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-quobyte-9f989ee6-167e-4d29-9394-ceb179dae2aa" acquired by "delete_volume" :: waited 0.028s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:15 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[443f7248-023e-418b-a412-f8e6238387f1]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b1a0ccc4-7203-4836-8cbc-f68254949ace tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e1835cf3-25f2-46f9-9506-be54e44918b8 tempest-SnapshotsActionsTest-975319395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e1835cf3-25f2-46f9-9506-be54e44918b8 tempest-SnapshotsActionsTest-975319395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-e1835cf3-25f2-46f9-9506-be54e44918b8 tempest-SnapshotsActionsTest-975319395 None] Creating offline snapshot e15ba784-e707-4dcd-a673-4937e50bb9ee of volume 982ec8aa-fbfc-4c99-b131-d0e27779b154 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:36:15 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[08dd7415-8ac3-4b21-8bcc-b0e9a86f8c9e]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e1835cf3-25f2-46f9-9506-be54e44918b8 tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:15 devstack sudo[99047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa Nov 06 14:36:15 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:15 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154 Nov 06 14:36:15 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:16 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b1a0ccc4-7203-4836-8cbc-f68254949ace tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa" returned: 0 in 0.484s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b1a0ccc4-7203-4836-8cbc-f68254949ace tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:16 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa Nov 06 14:36:16 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:16 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e1835cf3-25f2-46f9-9506-be54e44918b8 tempest-SnapshotsActionsTest-975319395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154" returned: 0 in 0.554s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e1835cf3-25f2-46f9-9506-be54e44918b8 tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:16 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee 1G Nov 06 14:36:16 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:16 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b1a0ccc4-7203-4836-8cbc-f68254949ace tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9f989ee6-167e-4d29-9394-ceb179dae2aa" returned: 0 in 0.330s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:16 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b1a0ccc4-7203-4836-8cbc-f68254949ace tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-quobyte-9f989ee6-167e-4d29-9394-ceb179dae2aa" released by "delete_volume" :: held 0.943s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:16 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-b1a0ccc4-7203-4836-8cbc-f68254949ace tempest-CreateVolumesFromSnapshotTest-808533590 None] Created reservations ['ae46f051-83d9-4b31-8479-1e1565ee010a', '9f327907-2b26-4968-8948-469b36538da9', '43920a12-6921-4787-a19c-c44600cc18b2', '3b36a574-8f97-4e94-b51e-6c919c836ecc'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b1a0ccc4-7203-4836-8cbc-f68254949ace tempest-CreateVolumesFromSnapshotTest-808533590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b1a0ccc4-7203-4836-8cbc-f68254949ace tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b1a0ccc4-7203-4836-8cbc-f68254949ace tempest-CreateVolumesFromSnapshotTest-808533590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b1a0ccc4-7203-4836-8cbc-f68254949ace tempest-CreateVolumesFromSnapshotTest-808533590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b1a0ccc4-7203-4836-8cbc-f68254949ace tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b1a0ccc4-7203-4836-8cbc-f68254949ace tempest-CreateVolumesFromSnapshotTest-808533590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:16 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:36:16 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:16 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e1835cf3-25f2-46f9-9506-be54e44918b8 tempest-SnapshotsActionsTest-975319395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee 1G" returned: 0 in 0.550s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e1835cf3-25f2-46f9-9506-be54e44918b8 tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982ec8aa-fbfc-4c99-b131-d0e27779b154 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:16 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982ec8aa-fbfc-4c99-b131-d0e27779b154 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee Nov 06 14:36:16 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:16 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b1a0ccc4-7203-4836-8cbc-f68254949ace tempest-CreateVolumesFromSnapshotTest-808533590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.320s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:16 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-b1a0ccc4-7203-4836-8cbc-f68254949ace tempest-CreateVolumesFromSnapshotTest-808533590 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:36:16 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-b1a0ccc4-7203-4836-8cbc-f68254949ace tempest-CreateVolumesFromSnapshotTest-808533590 None] Deleted volume successfully. Nov 06 14:36:16 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b1a0ccc4-7203-4836-8cbc-f68254949ace tempest-CreateVolumesFromSnapshotTest-808533590 None] Lock "cinder-9f989ee6-167e-4d29-9394-ceb179dae2aa-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:17 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e1835cf3-25f2-46f9-9506-be54e44918b8 tempest-SnapshotsActionsTest-975319395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982ec8aa-fbfc-4c99-b131-d0e27779b154 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee" returned: 0 in 0.394s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:17 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-e1835cf3-25f2-46f9-9506-be54e44918b8 tempest-SnapshotsActionsTest-975319395 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee is being set with open permissions: ugo+rw Nov 06 14:36:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e1835cf3-25f2-46f9-9506-be54e44918b8 tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:17 devstack sudo[99078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee Nov 06 14:36:17 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:17 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e1835cf3-25f2-46f9-9506-be54e44918b8 tempest-SnapshotsActionsTest-975319395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee" returned: 0 in 0.264s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e1835cf3-25f2-46f9-9506-be54e44918b8 tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:17 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.info Nov 06 14:36:17 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:17 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e1835cf3-25f2-46f9-9506-be54e44918b8 tempest-SnapshotsActionsTest-975319395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.info" returned: 0 in 0.366s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:17 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-e1835cf3-25f2-46f9-9506-be54e44918b8 tempest-SnapshotsActionsTest-975319395 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.info is being set with open permissions: ugo+rw Nov 06 14:36:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e1835cf3-25f2-46f9-9506-be54e44918b8 tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:17 devstack sudo[99084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.info Nov 06 14:36:17 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:18 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e1835cf3-25f2-46f9-9506-be54e44918b8 tempest-SnapshotsActionsTest-975319395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.info" returned: 0 in 0.325s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e1835cf3-25f2-46f9-9506-be54e44918b8 tempest-SnapshotsActionsTest-975319395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.589s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:18 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-e1835cf3-25f2-46f9-9506-be54e44918b8 tempest-SnapshotsActionsTest-975319395 None] Create snapshot completed successfully Nov 06 14:36:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6773aa62-7f98-4fab-80f7-49bcc83450f8 tempest-SnapshotsActionsTest-975319395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6773aa62-7f98-4fab-80f7-49bcc83450f8 tempest-SnapshotsActionsTest-975319395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-6773aa62-7f98-4fab-80f7-49bcc83450f8 tempest-SnapshotsActionsTest-975319395 None] Creating offline snapshot c0302171-28dc-4dcf-9a27-baa5214db586 of volume 982ec8aa-fbfc-4c99-b131-d0e27779b154 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:36:19 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40aefad-ddb9-4162-8e0c-e6400d84f8d8]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6773aa62-7f98-4fab-80f7-49bcc83450f8 tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:19 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee Nov 06 14:36:19 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:20 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6773aa62-7f98-4fab-80f7-49bcc83450f8 tempest-SnapshotsActionsTest-975319395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee" returned: 0 in 0.517s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-6773aa62-7f98-4fab-80f7-49bcc83450f8 tempest-SnapshotsActionsTest-975319395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-982ec8aa-fbfc-4c99-b131-d0e27779b154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:36:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6773aa62-7f98-4fab-80f7-49bcc83450f8 tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.c0302171-28dc-4dcf-9a27-baa5214db586 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:20 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.c0302171-28dc-4dcf-9a27-baa5214db586 1G Nov 06 14:36:20 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b7474c0e-f7d1-4311-be04-4175137db2ad tempest-AttachVolumeNegativeTest-1303646863 None] Acquiring lock "cinder-b37d4ffa-15ab-450a-ad11-1defde82daf4-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b7474c0e-f7d1-4311-be04-4175137db2ad tempest-AttachVolumeNegativeTest-1303646863 None] Lock "cinder-b37d4ffa-15ab-450a-ad11-1defde82daf4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b7474c0e-f7d1-4311-be04-4175137db2ad tempest-AttachVolumeNegativeTest-1303646863 None] Acquiring lock "cinder-quobyte-b37d4ffa-15ab-450a-ad11-1defde82daf4" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b7474c0e-f7d1-4311-be04-4175137db2ad tempest-AttachVolumeNegativeTest-1303646863 None] Lock "cinder-quobyte-b37d4ffa-15ab-450a-ad11-1defde82daf4" acquired by "delete_volume" :: waited 0.020s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:20 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e768953-7334-4e4c-8507-e448b1e735d2]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b7474c0e-f7d1-4311-be04-4175137db2ad tempest-AttachVolumeNegativeTest-1303646863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b37d4ffa-15ab-450a-ad11-1defde82daf4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:20 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b37d4ffa-15ab-450a-ad11-1defde82daf4 Nov 06 14:36:20 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:20 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6773aa62-7f98-4fab-80f7-49bcc83450f8 tempest-SnapshotsActionsTest-975319395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.c0302171-28dc-4dcf-9a27-baa5214db586 1G" returned: 0 in 0.760s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6773aa62-7f98-4fab-80f7-49bcc83450f8 tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.c0302171-28dc-4dcf-9a27-baa5214db586 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:21 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.c0302171-28dc-4dcf-9a27-baa5214db586 Nov 06 14:36:21 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:36:21 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Flow 'volume_create_manager' (7c9826c0-a226-4e8e-a464-1af904912b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f945c06c-1906-4d99-8253-610bea6521f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b7474c0e-f7d1-4311-be04-4175137db2ad tempest-AttachVolumeNegativeTest-1303646863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b37d4ffa-15ab-450a-ad11-1defde82daf4" returned: 0 in 0.500s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b7474c0e-f7d1-4311-be04-4175137db2ad tempest-AttachVolumeNegativeTest-1303646863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b37d4ffa-15ab-450a-ad11-1defde82daf4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f945c06c-1906-4d99-8253-610bea6521f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e467e467-2e99-4d27-9b3e-af4882a2e159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4a069c421241dbbdc4f21655bd49f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:21Z,use_quota=True,user_id='f52ce72f4ced458d8e0d9e29afb1d3a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:21 devstack sudo[99110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b37d4ffa-15ab-450a-ad11-1defde82daf4 Nov 06 14:36:21 devstack sudo[99110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a36a882-b302-402a-a305-f0f62f175fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a36a882-b302-402a-a305-f0f62f175fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6354bb96-1e58-4a2a-84c8-99364cb5bd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6354bb96-1e58-4a2a-84c8-99364cb5bd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e467e467-2e99-4d27-9b3e-af4882a2e159', 'volume_name': 'volume-e467e467-2e99-4d27-9b3e-af4882a2e159', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dcc4b52-a437-4afa-9cc9-2849987777fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dcc4b52-a437-4afa-9cc9-2849987777fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (949c7afe-3b20-456d-8dc6-92c99b723516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:21 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Volume e467e467-2e99-4d27-9b3e-af4882a2e159: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e467e467-2e99-4d27-9b3e-af4882a2e159', 'volume_size': 1} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:21 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6773aa62-7f98-4fab-80f7-49bcc83450f8 tempest-SnapshotsActionsTest-975319395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.c0302171-28dc-4dcf-9a27-baa5214db586" returned: 0 in 0.409s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:21 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-6773aa62-7f98-4fab-80f7-49bcc83450f8 tempest-SnapshotsActionsTest-975319395 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.c0302171-28dc-4dcf-9a27-baa5214db586 is being set with open permissions: ugo+rw Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6773aa62-7f98-4fab-80f7-49bcc83450f8 tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.c0302171-28dc-4dcf-9a27-baa5214db586 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:21 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.c0302171-28dc-4dcf-9a27-baa5214db586 Nov 06 14:36:21 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:21 devstack sudo[99110]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b7474c0e-f7d1-4311-be04-4175137db2ad tempest-AttachVolumeNegativeTest-1303646863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b37d4ffa-15ab-450a-ad11-1defde82daf4" returned: 0 in 0.305s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b7474c0e-f7d1-4311-be04-4175137db2ad tempest-AttachVolumeNegativeTest-1303646863 None] Lock "cinder-quobyte-b37d4ffa-15ab-450a-ad11-1defde82daf4" released by "delete_volume" :: held 0.854s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:36:21 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Flow 'volume_create_manager' (4cb60b44-5afd-4440-8a23-60c9441b9f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc23c3b-366e-478b-9b39-fa11e1a7d721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6773aa62-7f98-4fab-80f7-49bcc83450f8 tempest-SnapshotsActionsTest-975319395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.c0302171-28dc-4dcf-9a27-baa5214db586" returned: 0 in 0.287s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc23c3b-366e-478b-9b39-fa11e1a7d721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1795708910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fab77ad0-10b3-42ba-a198-fcfb46344039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab7d132605447d5bee4208da5252eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:22Z,use_quota=True,user_id='d473df335996483dbbbf5c5849c7c25a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac27174-d307-4848-8757-6a0ed2f8b84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac27174-d307-4848-8757-6a0ed2f8b84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ecb98f-5766-407f-9bc1-0ede18d49154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ecb98f-5766-407f-9bc1-0ede18d49154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fab77ad0-10b3-42ba-a198-fcfb46344039', 'volume_name': 'volume-fab77ad0-10b3-42ba-a198-fcfb46344039', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7586713-4e67-4e3f-92fa-89f8037fdb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7586713-4e67-4e3f-92fa-89f8037fdb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d1e781-db54-4479-9b8b-d50bd0b1eb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:21 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Volume fab77ad0-10b3-42ba-a198-fcfb46344039: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fab77ad0-10b3-42ba-a198-fcfb46344039', 'volume_size': 1} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6773aa62-7f98-4fab-80f7-49bcc83450f8 tempest-SnapshotsActionsTest-975319395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.152s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.384s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e467e467-2e99-4d27-9b3e-af4882a2e159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4a069c421241dbbdc4f21655bd49f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:21Z,use_quota=True,user_id='f52ce72f4ced458d8e0d9e29afb1d3a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Creating volume e467e467-2e99-4d27-9b3e-af4882a2e159 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:36:21 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e467e467-2e99-4d27-9b3e-af4882a2e159 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:21 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e467e467-2e99-4d27-9b3e-af4882a2e159 1073741824 Nov 06 14:36:21 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:21 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-6773aa62-7f98-4fab-80f7-49bcc83450f8 tempest-SnapshotsActionsTest-975319395 None] Create snapshot completed successfully Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-b7474c0e-f7d1-4311-be04-4175137db2ad tempest-AttachVolumeNegativeTest-1303646863 None] Created reservations ['5b61b561-2ebe-417e-aaca-cb6762b806c8', 'bae68fce-fbc0-438b-be4e-ef15829884f3', '3b080788-c05a-443f-ae17-c177a452124c', 'a6a15889-6ea2-4fcf-bd9d-24a4a14b48f9'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b7474c0e-f7d1-4311-be04-4175137db2ad tempest-AttachVolumeNegativeTest-1303646863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b7474c0e-f7d1-4311-be04-4175137db2ad tempest-AttachVolumeNegativeTest-1303646863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b7474c0e-f7d1-4311-be04-4175137db2ad tempest-AttachVolumeNegativeTest-1303646863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b7474c0e-f7d1-4311-be04-4175137db2ad tempest-AttachVolumeNegativeTest-1303646863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b7474c0e-f7d1-4311-be04-4175137db2ad tempest-AttachVolumeNegativeTest-1303646863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b7474c0e-f7d1-4311-be04-4175137db2ad tempest-AttachVolumeNegativeTest-1303646863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:21 devstack sudo[99120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:36:21 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:22 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b7474c0e-f7d1-4311-be04-4175137db2ad tempest-AttachVolumeNegativeTest-1303646863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.243s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-b7474c0e-f7d1-4311-be04-4175137db2ad tempest-AttachVolumeNegativeTest-1303646863 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:36:22 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-b7474c0e-f7d1-4311-be04-4175137db2ad tempest-AttachVolumeNegativeTest-1303646863 None] Deleted volume successfully. Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b7474c0e-f7d1-4311-be04-4175137db2ad tempest-AttachVolumeNegativeTest-1303646863 None] Lock "cinder-b37d4ffa-15ab-450a-ad11-1defde82daf4-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:22 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e467e467-2e99-4d27-9b3e-af4882a2e159 1073741824" returned: 0 in 0.489s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e467e467-2e99-4d27-9b3e-af4882a2e159 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:22 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e467e467-2e99-4d27-9b3e-af4882a2e159 Nov 06 14:36:22 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8d079171-0b3e-4c40-9bcc-67f4357e2b64 tempest-AttachVolumeNegativeTest-1303646863 None] Acquiring lock "cinder-2be36def-c369-4b1f-88ea-6f4793f4fcb5-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8d079171-0b3e-4c40-9bcc-67f4357e2b64 tempest-AttachVolumeNegativeTest-1303646863 None] Lock "cinder-2be36def-c369-4b1f-88ea-6f4793f4fcb5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8d079171-0b3e-4c40-9bcc-67f4357e2b64 tempest-AttachVolumeNegativeTest-1303646863 None] Acquiring lock "cinder-quobyte-2be36def-c369-4b1f-88ea-6f4793f4fcb5" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8d079171-0b3e-4c40-9bcc-67f4357e2b64 tempest-AttachVolumeNegativeTest-1303646863 None] Lock "cinder-quobyte-2be36def-c369-4b1f-88ea-6f4793f4fcb5" acquired by "delete_volume" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[a812d122-a2ed-479d-ac64-8403759397f2]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8d079171-0b3e-4c40-9bcc-67f4357e2b64 tempest-AttachVolumeNegativeTest-1303646863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2be36def-c369-4b1f-88ea-6f4793f4fcb5 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:22 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e467e467-2e99-4d27-9b3e-af4882a2e159" returned: 0 in 0.281s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.866s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1795708910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fab77ad0-10b3-42ba-a198-fcfb46344039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab7d132605447d5bee4208da5252eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:22Z,use_quota=True,user_id='d473df335996483dbbbf5c5849c7c25a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Creating volume fab77ad0-10b3-42ba-a198-fcfb46344039 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:36:22 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fab77ad0-10b3-42ba-a198-fcfb46344039 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:22 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2be36def-c369-4b1f-88ea-6f4793f4fcb5 Nov 06 14:36:22 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (949c7afe-3b20-456d-8dc6-92c99b723516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e467e467-2e99-4d27-9b3e-af4882a2e159', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:22 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fab77ad0-10b3-42ba-a198-fcfb46344039 1073741824 Nov 06 14:36:22 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175b0a09-af72-44ba-82a5-a78fe57c8526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:22 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Volume volume-e467e467-2e99-4d27-9b3e-af4882a2e159 (e467e467-2e99-4d27-9b3e-af4882a2e159): created successfully Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175b0a09-af72-44ba-82a5-a78fe57c8526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Flow 'volume_create_manager' (7c9826c0-a226-4e8e-a464-1af904912b6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:22 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-130c7865-7853-4b7a-896e-968e3db23c01 tempest-CinderUnicodeTest-1266181149 None] Created volume successfully. Nov 06 14:36:22 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8d079171-0b3e-4c40-9bcc-67f4357e2b64 tempest-AttachVolumeNegativeTest-1303646863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2be36def-c369-4b1f-88ea-6f4793f4fcb5" returned: 0 in 0.402s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8d079171-0b3e-4c40-9bcc-67f4357e2b64 tempest-AttachVolumeNegativeTest-1303646863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2be36def-c369-4b1f-88ea-6f4793f4fcb5 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:22 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2be36def-c369-4b1f-88ea-6f4793f4fcb5 Nov 06 14:36:22 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-be80643c-a38a-4137-a441-862d6b65c1de tempest-SnapshotsActionsTest-893473510 None] Acquiring lock "cinder-c0302171-28dc-4dcf-9a27-baa5214db586-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-be80643c-a38a-4137-a441-862d6b65c1de tempest-SnapshotsActionsTest-893473510 None] Lock "cinder-c0302171-28dc-4dcf-9a27-baa5214db586-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-be80643c-a38a-4137-a441-862d6b65c1de tempest-SnapshotsActionsTest-893473510 None] Acquiring lock "cinder-quobyte-982ec8aa-fbfc-4c99-b131-d0e27779b154" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-be80643c-a38a-4137-a441-862d6b65c1de tempest-SnapshotsActionsTest-893473510 None] Lock "cinder-quobyte-982ec8aa-fbfc-4c99-b131-d0e27779b154" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-be80643c-a38a-4137-a441-862d6b65c1de tempest-SnapshotsActionsTest-893473510 None] Acquiring lock "cinder-quobyte-c0302171-28dc-4dcf-9a27-baa5214db586" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-be80643c-a38a-4137-a441-862d6b65c1de tempest-SnapshotsActionsTest-893473510 None] Lock "cinder-quobyte-c0302171-28dc-4dcf-9a27-baa5214db586" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-be80643c-a38a-4137-a441-862d6b65c1de tempest-SnapshotsActionsTest-893473510 None] Deleting offline snapshot c0302171-28dc-4dcf-9a27-baa5214db586 of volume 982ec8aa-fbfc-4c99-b131-d0e27779b154 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-be80643c-a38a-4137-a441-862d6b65c1de tempest-SnapshotsActionsTest-893473510 None] snapshot_file for this snap is: volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.c0302171-28dc-4dcf-9a27-baa5214db586 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[541fc901-b593-4321-88a9-175d72237107]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-be80643c-a38a-4137-a441-862d6b65c1de tempest-SnapshotsActionsTest-893473510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.c0302171-28dc-4dcf-9a27-baa5214db586 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:23 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fab77ad0-10b3-42ba-a198-fcfb46344039 1073741824" returned: 0 in 0.529s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:23 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:36:23 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fab77ad0-10b3-42ba-a198-fcfb46344039 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:23 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.c0302171-28dc-4dcf-9a27-baa5214db586 Nov 06 14:36:23 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:23 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8d079171-0b3e-4c40-9bcc-67f4357e2b64 tempest-AttachVolumeNegativeTest-1303646863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2be36def-c369-4b1f-88ea-6f4793f4fcb5" returned: 0 in 0.296s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:23 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fab77ad0-10b3-42ba-a198-fcfb46344039 Nov 06 14:36:23 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8d079171-0b3e-4c40-9bcc-67f4357e2b64 tempest-AttachVolumeNegativeTest-1303646863 None] Lock "cinder-quobyte-2be36def-c369-4b1f-88ea-6f4793f4fcb5" released by "delete_volume" :: held 0.748s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-8d079171-0b3e-4c40-9bcc-67f4357e2b64 tempest-AttachVolumeNegativeTest-1303646863 None] Created reservations ['60b45afe-22d9-4e23-9fc0-5e2291bd4958', '139c49be-7952-49b8-8730-fd838884d88a', '750d2f8c-c610-4b68-b550-c9446c31b1da', '16c947ef-0288-425e-afcf-eaa6f21036ac'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8d079171-0b3e-4c40-9bcc-67f4357e2b64 tempest-AttachVolumeNegativeTest-1303646863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8d079171-0b3e-4c40-9bcc-67f4357e2b64 tempest-AttachVolumeNegativeTest-1303646863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8d079171-0b3e-4c40-9bcc-67f4357e2b64 tempest-AttachVolumeNegativeTest-1303646863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8d079171-0b3e-4c40-9bcc-67f4357e2b64 tempest-AttachVolumeNegativeTest-1303646863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8d079171-0b3e-4c40-9bcc-67f4357e2b64 tempest-AttachVolumeNegativeTest-1303646863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8d079171-0b3e-4c40-9bcc-67f4357e2b64 tempest-AttachVolumeNegativeTest-1303646863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:23 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:36:23 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:23 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.299s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager._thread_info {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread count: 28 {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread info: [<_MainThread(MainThread, started 130306900594816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 14:36:23 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fab77ad0-10b3-42ba-a198-fcfb46344039" returned: 0 in 0.338s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d1e781-db54-4479-9b8b-d50bd0b1eb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fab77ad0-10b3-42ba-a198-fcfb46344039', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509fecc1-b147-4763-8eb0-079def7138ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:23 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Volume volume-fab77ad0-10b3-42ba-a198-fcfb46344039 (fab77ad0-10b3-42ba-a198-fcfb46344039): created successfully Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509fecc1-b147-4763-8eb0-079def7138ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Flow 'volume_create_manager' (4cb60b44-5afd-4440-8a23-60c9441b9f91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:23 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-517cf2e1-c247-493e-a6ed-73cdd6e0ca22 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Created volume successfully. Nov 06 14:36:23 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-be80643c-a38a-4137-a441-862d6b65c1de tempest-SnapshotsActionsTest-893473510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.c0302171-28dc-4dcf-9a27-baa5214db586" returned: 0 in 0.575s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-be80643c-a38a-4137-a441-862d6b65c1de tempest-SnapshotsActionsTest-893473510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-982ec8aa-fbfc-4c99-b131-d0e27779b154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c93062-d5c7-4313-b1df-2f3ac2d25937]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-be80643c-a38a-4137-a441-862d6b65c1de tempest-SnapshotsActionsTest-893473510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:23 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8d079171-0b3e-4c40-9bcc-67f4357e2b64 tempest-AttachVolumeNegativeTest-1303646863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.407s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-8d079171-0b3e-4c40-9bcc-67f4357e2b64 tempest-AttachVolumeNegativeTest-1303646863 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:36:23 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-8d079171-0b3e-4c40-9bcc-67f4357e2b64 tempest-AttachVolumeNegativeTest-1303646863 None] Deleted volume successfully. Nov 06 14:36:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8d079171-0b3e-4c40-9bcc-67f4357e2b64 tempest-AttachVolumeNegativeTest-1303646863 None] Lock "cinder-2be36def-c369-4b1f-88ea-6f4793f4fcb5-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:23 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee Nov 06 14:36:23 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-37c9e5d2-228c-4313-86aa-4724f9adc139 tempest-AttachVolumeNegativeTest-1303646863 None] Acquiring lock "cinder-c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-37c9e5d2-228c-4313-86aa-4724f9adc139 tempest-AttachVolumeNegativeTest-1303646863 None] Lock "cinder-c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-37c9e5d2-228c-4313-86aa-4724f9adc139 tempest-AttachVolumeNegativeTest-1303646863 None] Acquiring lock "cinder-quobyte-c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-37c9e5d2-228c-4313-86aa-4724f9adc139 tempest-AttachVolumeNegativeTest-1303646863 None] Lock "cinder-quobyte-c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4" acquired by "delete_volume" :: waited 0.022s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0e4055-81be-4805-9faa-b46ed6ce9061]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-37c9e5d2-228c-4313-86aa-4724f9adc139 tempest-AttachVolumeNegativeTest-1303646863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:36:24 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Flow 'volume_create_manager' (03100959-5294-4584-8e89-631b312872d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc1241b-f80f-4c80-a7e0-6ed1f278d843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-be80643c-a38a-4137-a441-862d6b65c1de tempest-SnapshotsActionsTest-893473510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee" returned: 0 in 0.622s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-be80643c-a38a-4137-a441-862d6b65c1de tempest-SnapshotsActionsTest-893473510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-982ec8aa-fbfc-4c99-b131-d0e27779b154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-be80643c-a38a-4137-a441-862d6b65c1de tempest-SnapshotsActionsTest-893473510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.c0302171-28dc-4dcf-9a27-baa5214db586 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc1241b-f80f-4c80-a7e0-6ed1f278d843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1331112004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7ad965-4574-4300-a4b1-e8c8a56bc3f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4a069c421241dbbdc4f21655bd49f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:24Z,use_quota=True,user_id='f52ce72f4ced458d8e0d9e29afb1d3a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (972d7a29-37e1-42bc-8f12-54e296b61d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (972d7a29-37e1-42bc-8f12-54e296b61d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:24 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.c0302171-28dc-4dcf-9a27-baa5214db586 Nov 06 14:36:24 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:24 devstack sudo[99165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4 Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (641496d8-68f7-45fb-a6d5-92617a1e9719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:24 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (641496d8-68f7-45fb-a6d5-92617a1e9719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf7ad965-4574-4300-a4b1-e8c8a56bc3f8', 'volume_name': 'volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b06b249-3a70-499d-ac29-11ba01ff9fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b06b249-3a70-499d-ac29-11ba01ff9fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3915789f-ee5a-423d-a5e8-180f22625561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:24 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Volume bf7ad965-4574-4300-a4b1-e8c8a56bc3f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8', 'volume_size': 1} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1331112004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7ad965-4574-4300-a4b1-e8c8a56bc3f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4a069c421241dbbdc4f21655bd49f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:24Z,use_quota=True,user_id='f52ce72f4ced458d8e0d9e29afb1d3a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Creating volume bf7ad965-4574-4300-a4b1-e8c8a56bc3f8 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:36:24 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:24 devstack sudo[99169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8 1073741824 Nov 06 14:36:24 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Flow 'volume_create_manager' (560c2d71-0ac3-4822-90e3-88ebb174956e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d3c9b1-7408-43f4-a9f2-1d3ce31fa735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d3c9b1-7408-43f4-a9f2-1d3ce31fa735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-640558091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3608f6c0-0609-4f9c-b941-1ad1001bfd9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab7d132605447d5bee4208da5252eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:24Z,use_quota=True,user_id='d473df335996483dbbbf5c5849c7c25a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef45499-361a-4bb2-8c62-920cb623332f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef45499-361a-4bb2-8c62-920cb623332f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ea61e6-b394-42e2-a8a1-d2eb3a777dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ea61e6-b394-42e2-a8a1-d2eb3a777dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3608f6c0-0609-4f9c-b941-1ad1001bfd9f', 'volume_name': 'volume-3608f6c0-0609-4f9c-b941-1ad1001bfd9f', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4e2c00e-3f84-4cb1-84fc-1ee3bdc6fa2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4e2c00e-3f84-4cb1-84fc-1ee3bdc6fa2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41d42b2f-11bf-4554-823e-a2b5e8b69caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:24 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Volume 3608f6c0-0609-4f9c-b941-1ad1001bfd9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3608f6c0-0609-4f9c-b941-1ad1001bfd9f', 'volume_size': 1} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:24 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:36:24 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Flow 'volume_create_manager' (c83a7047-abf2-4796-9ac3-d7abccd4a635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e18f4c2d-c482-43b2-a1f8-37a40e00e23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-37c9e5d2-228c-4313-86aa-4724f9adc139 tempest-AttachVolumeNegativeTest-1303646863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4" returned: 0 in 0.651s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-be80643c-a38a-4137-a441-862d6b65c1de tempest-SnapshotsActionsTest-893473510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.c0302171-28dc-4dcf-9a27-baa5214db586" returned: 0 in 0.535s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-37c9e5d2-228c-4313-86aa-4724f9adc139 tempest-AttachVolumeNegativeTest-1303646863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-be80643c-a38a-4137-a441-862d6b65c1de tempest-SnapshotsActionsTest-893473510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.c0302171-28dc-4dcf-9a27-baa5214db586 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:24 devstack sudo[99182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4 Nov 06 14:36:24 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e18f4c2d-c482-43b2-a1f8-37a40e00e23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-90608747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c846931c-00db-40e7-a7f9-f4454c1ec271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab7d132605447d5bee4208da5252eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:25Z,use_quota=True,user_id='d473df335996483dbbbf5c5849c7c25a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7d2541-e17a-4c07-a2fc-56f6f625d2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:24 devstack sudo[99183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.c0302171-28dc-4dcf-9a27-baa5214db586 Nov 06 14:36:24 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7d2541-e17a-4c07-a2fc-56f6f625d2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c03203-924f-49e7-9f7e-28ee43dd507c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c03203-924f-49e7-9f7e-28ee43dd507c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c846931c-00db-40e7-a7f9-f4454c1ec271', 'volume_name': 'volume-c846931c-00db-40e7-a7f9-f4454c1ec271', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3df31a2-d197-4b41-8854-4ec843290472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3df31a2-d197-4b41-8854-4ec843290472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206452fc-a26f-4577-bee8-f819780ec3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:24 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Volume c846931c-00db-40e7-a7f9-f4454c1ec271: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c846931c-00db-40e7-a7f9-f4454c1ec271', 'volume_size': 1} Nov 06 14:36:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:25 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8 1073741824" returned: 0 in 0.624s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:25 devstack sudo[99186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8 Nov 06 14:36:25 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:25 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-37c9e5d2-228c-4313-86aa-4724f9adc139 tempest-AttachVolumeNegativeTest-1303646863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4" returned: 0 in 0.415s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-37c9e5d2-228c-4313-86aa-4724f9adc139 tempest-AttachVolumeNegativeTest-1303646863 None] Lock "cinder-quobyte-c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4" released by "delete_volume" :: held 1.133s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:25 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-be80643c-a38a-4137-a441-862d6b65c1de tempest-SnapshotsActionsTest-893473510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.c0302171-28dc-4dcf-9a27-baa5214db586" returned: 0 in 0.473s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-be80643c-a38a-4137-a441-862d6b65c1de tempest-SnapshotsActionsTest-893473510 None] Lock "cinder-quobyte-c0302171-28dc-4dcf-9a27-baa5214db586" released by "_delete_snapshot" :: held 2.339s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-be80643c-a38a-4137-a441-862d6b65c1de tempest-SnapshotsActionsTest-893473510 None] Lock "cinder-quobyte-982ec8aa-fbfc-4c99-b131-d0e27779b154" released by "delete_snapshot" :: held 2.379s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Flow 'volume_create_manager' (16c15537-183a-4091-8e12-06b9fc0e4a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9220711d-af33-4ec5-a8f7-433434c2bdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:25 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9220711d-af33-4ec5-a8f7-433434c2bdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1893988056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b746e5-aa12-4c9d-98bd-6232c302f402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab7d132605447d5bee4208da5252eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:25Z,use_quota=True,user_id='d473df335996483dbbbf5c5849c7c25a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2e4547-33e1-43e2-8bab-ec3a51d7eefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2e4547-33e1-43e2-8bab-ec3a51d7eefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58522bfa-4ce8-4ba2-bcc7-f8d9454b0449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58522bfa-4ce8-4ba2-bcc7-f8d9454b0449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57b746e5-aa12-4c9d-98bd-6232c302f402', 'volume_name': 'volume-57b746e5-aa12-4c9d-98bd-6232c302f402', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb764f14-e595-423a-8224-d44fde5a7c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb764f14-e595-423a-8224-d44fde5a7c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d153bf85-583c-4318-affa-2f229b367f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:25 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Volume 57b746e5-aa12-4c9d-98bd-6232c302f402: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57b746e5-aa12-4c9d-98bd-6232c302f402', 'volume_size': 1} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8" returned: 0 in 0.401s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.736s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-640558091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3608f6c0-0609-4f9c-b941-1ad1001bfd9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab7d132605447d5bee4208da5252eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:24Z,use_quota=True,user_id='d473df335996483dbbbf5c5849c7c25a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Creating volume 3608f6c0-0609-4f9c-b941-1ad1001bfd9f {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:36:25 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3608f6c0-0609-4f9c-b941-1ad1001bfd9f 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:25 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3608f6c0-0609-4f9c-b941-1ad1001bfd9f 1073741824 Nov 06 14:36:25 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3915789f-ee5a-423d-a5e8-180f22625561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cccef04-c788-4b5e-af73-b6ee47b8d944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-37c9e5d2-228c-4313-86aa-4724f9adc139 tempest-AttachVolumeNegativeTest-1303646863 None] Created reservations ['22e3727b-691d-4743-8faa-2f1ea76e478f', '53f24e54-47fa-46b5-9e97-1e17525dc78c', 'e7789333-051b-4912-8f86-102e8b6294fb', '31aa1289-cfb7-4928-a33f-e09f1be8c046'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:25 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Volume volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8 (bf7ad965-4574-4300-a4b1-e8c8a56bc3f8): created successfully Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cccef04-c788-4b5e-af73-b6ee47b8d944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Flow 'volume_create_manager' (03100959-5294-4584-8e89-631b312872d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:25 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-abd27844-6f2f-4b0a-9480-0382eef2f953 tempest-CinderUnicodeTest-1266181149 None] Created volume successfully. Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-be80643c-a38a-4137-a441-862d6b65c1de tempest-SnapshotsActionsTest-893473510 None] Created reservations ['0b05bfd5-18df-4fa2-ab77-fa96db7b7f71', 'd48a3cc6-9e3d-45aa-bc6f-9e73267b84f8', '7a514e58-b438-4b29-8a64-28bbcb180ba5', '76ffc3f0-91cc-4aeb-8d2d-6ce0ba5b4e05'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-37c9e5d2-228c-4313-86aa-4724f9adc139 tempest-AttachVolumeNegativeTest-1303646863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-37c9e5d2-228c-4313-86aa-4724f9adc139 tempest-AttachVolumeNegativeTest-1303646863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-37c9e5d2-228c-4313-86aa-4724f9adc139 tempest-AttachVolumeNegativeTest-1303646863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-37c9e5d2-228c-4313-86aa-4724f9adc139 tempest-AttachVolumeNegativeTest-1303646863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-37c9e5d2-228c-4313-86aa-4724f9adc139 tempest-AttachVolumeNegativeTest-1303646863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-37c9e5d2-228c-4313-86aa-4724f9adc139 tempest-AttachVolumeNegativeTest-1303646863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:25 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:36:25 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:25 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-be80643c-a38a-4137-a441-862d6b65c1de tempest-SnapshotsActionsTest-893473510 None] Delete snapshot completed successfully. Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-be80643c-a38a-4137-a441-862d6b65c1de tempest-SnapshotsActionsTest-893473510 None] Lock "cinder-c0302171-28dc-4dcf-9a27-baa5214db586-delete_snapshot" released by "delete_snapshot" :: held 2.808s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Flow 'volume_create_manager' (b70794af-25bc-42e6-a809-e33c9859873b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32231af2-7a2e-463a-ade6-bfeca7e252e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32231af2-7a2e-463a-ade6-bfeca7e252e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1194059190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b1a2836-96f6-49f9-b106-b5fbdeabcd06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab7d132605447d5bee4208da5252eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:26Z,use_quota=True,user_id='d473df335996483dbbbf5c5849c7c25a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92eff531-2ce2-4059-907d-850f3f77d79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92eff531-2ce2-4059-907d-850f3f77d79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f2e516-d69d-45f6-bd5a-b1f49fdd76df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f2e516-d69d-45f6-bd5a-b1f49fdd76df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b1a2836-96f6-49f9-b106-b5fbdeabcd06', 'volume_name': 'volume-1b1a2836-96f6-49f9-b106-b5fbdeabcd06', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c9123f0-cfb1-4df1-93a0-976ef12f13bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c9123f0-cfb1-4df1-93a0-976ef12f13bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d8095bd-685f-4008-921a-b839508a65f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:25 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Volume 1b1a2836-96f6-49f9-b106-b5fbdeabcd06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b1a2836-96f6-49f9-b106-b5fbdeabcd06', 'volume_size': 1} Nov 06 14:36:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:26 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-37c9e5d2-228c-4313-86aa-4724f9adc139 tempest-AttachVolumeNegativeTest-1303646863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.293s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-37c9e5d2-228c-4313-86aa-4724f9adc139 tempest-AttachVolumeNegativeTest-1303646863 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:36:26 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-37c9e5d2-228c-4313-86aa-4724f9adc139 tempest-AttachVolumeNegativeTest-1303646863 None] Deleted volume successfully. Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-37c9e5d2-228c-4313-86aa-4724f9adc139 tempest-AttachVolumeNegativeTest-1303646863 None] Lock "cinder-c8d2a20c-4f78-42c8-9b1b-1c05be29b0f4-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:26 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3608f6c0-0609-4f9c-b941-1ad1001bfd9f 1073741824" returned: 0 in 0.558s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3608f6c0-0609-4f9c-b941-1ad1001bfd9f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:26 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3608f6c0-0609-4f9c-b941-1ad1001bfd9f Nov 06 14:36:26 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Flow 'volume_create_manager' (258fcc4e-fa99-4f52-a3f6-53eab9d86b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32cb0989-3ed9-4749-b796-a0ab1a4d732b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:26 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3608f6c0-0609-4f9c-b941-1ad1001bfd9f" returned: 0 in 0.299s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.494s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-90608747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c846931c-00db-40e7-a7f9-f4454c1ec271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab7d132605447d5bee4208da5252eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:25Z,use_quota=True,user_id='d473df335996483dbbbf5c5849c7c25a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Creating volume c846931c-00db-40e7-a7f9-f4454c1ec271 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:36:26 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c846931c-00db-40e7-a7f9-f4454c1ec271 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32cb0989-3ed9-4749-b796-a0ab1a4d732b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-719630399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b05da46d-c4ee-4bc2-9847-d3e92d82471d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab7d132605447d5bee4208da5252eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:26Z,use_quota=True,user_id='d473df335996483dbbbf5c5849c7c25a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:26 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c846931c-00db-40e7-a7f9-f4454c1ec271 1073741824 Nov 06 14:36:26 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50833034-22a2-46c5-9cbd-c632ab3f2eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50833034-22a2-46c5-9cbd-c632ab3f2eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bbcfd72-572e-4b19-80de-2612917db7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bbcfd72-572e-4b19-80de-2612917db7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b05da46d-c4ee-4bc2-9847-d3e92d82471d', 'volume_name': 'volume-b05da46d-c4ee-4bc2-9847-d3e92d82471d', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6685b2-23a5-4699-b957-4f0a25bb2896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6685b2-23a5-4699-b957-4f0a25bb2896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5759692c-fe38-4848-9a50-2b6300b68f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:26 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Volume b05da46d-c4ee-4bc2-9847-d3e92d82471d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b05da46d-c4ee-4bc2-9847-d3e92d82471d', 'volume_size': 1} Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41d42b2f-11bf-4554-823e-a2b5e8b69caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3608f6c0-0609-4f9c-b941-1ad1001bfd9f', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4e60c8-3be3-43b6-90c2-5f5328c9521d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:26 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Volume volume-3608f6c0-0609-4f9c-b941-1ad1001bfd9f (3608f6c0-0609-4f9c-b941-1ad1001bfd9f): created successfully Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4e60c8-3be3-43b6-90c2-5f5328c9521d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Flow 'volume_create_manager' (560c2d71-0ac3-4822-90e3-88ebb174956e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:26 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-243b8674-3db4-4c61-afa9-e7e3a5b9e3ab tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Created volume successfully. Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2614e514-3d5f-407e-b3f4-4b41616bda2e tempest-CinderUnicodeTest-1266181149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-20684062-a320-4a2c-9608-a6be2fdc6e42 tempest-SnapshotsActionsTest-975319395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:27 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c846931c-00db-40e7-a7f9-f4454c1ec271 1073741824" returned: 0 in 0.570s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c846931c-00db-40e7-a7f9-f4454c1ec271 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:27 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c846931c-00db-40e7-a7f9-f4454c1ec271 Nov 06 14:36:27 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:27 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c846931c-00db-40e7-a7f9-f4454c1ec271" returned: 0 in 0.278s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:27 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:36:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.840s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:27 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1893988056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b746e5-aa12-4c9d-98bd-6232c302f402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab7d132605447d5bee4208da5252eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:25Z,use_quota=True,user_id='d473df335996483dbbbf5c5849c7c25a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:36:27 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Creating volume 57b746e5-aa12-4c9d-98bd-6232c302f402 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:36:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:27 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:27 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:27 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:36:27 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:36:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-57b746e5-aa12-4c9d-98bd-6232c302f402 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206452fc-a26f-4577-bee8-f819780ec3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c846931c-00db-40e7-a7f9-f4454c1ec271', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37efea88-2439-4d84-9f9f-bb45dba6772f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:27 devstack sudo[99213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-57b746e5-aa12-4c9d-98bd-6232c302f402 1073741824 Nov 06 14:36:27 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:27 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Volume volume-c846931c-00db-40e7-a7f9-f4454c1ec271 (c846931c-00db-40e7-a7f9-f4454c1ec271): created successfully Nov 06 14:36:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37efea88-2439-4d84-9f9f-bb45dba6772f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Flow 'volume_create_manager' (c83a7047-abf2-4796-9ac3-d7abccd4a635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:27 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-f8cdd4d7-27e8-46e7-873e-35d373e79184 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Created volume successfully. Nov 06 14:36:27 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-57b746e5-aa12-4c9d-98bd-6232c302f402 1073741824" returned: 0 in 0.495s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-57b746e5-aa12-4c9d-98bd-6232c302f402 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:27 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-57b746e5-aa12-4c9d-98bd-6232c302f402 Nov 06 14:36:27 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:28 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-57b746e5-aa12-4c9d-98bd-6232c302f402" returned: 0 in 0.285s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:36:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.237s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1194059190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b1a2836-96f6-49f9-b106-b5fbdeabcd06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab7d132605447d5bee4208da5252eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:26Z,use_quota=True,user_id='d473df335996483dbbbf5c5849c7c25a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:36:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Creating volume 1b1a2836-96f6-49f9-b106-b5fbdeabcd06 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:36:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:36:28 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:36:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b1a2836-96f6-49f9-b106-b5fbdeabcd06 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d153bf85-583c-4318-affa-2f229b367f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57b746e5-aa12-4c9d-98bd-6232c302f402', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:28 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b1a2836-96f6-49f9-b106-b5fbdeabcd06 1073741824 Nov 06 14:36:28 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a461dfd-5c61-4f18-a3af-46d00a6aa357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:28 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Volume volume-57b746e5-aa12-4c9d-98bd-6232c302f402 (57b746e5-aa12-4c9d-98bd-6232c302f402): created successfully Nov 06 14:36:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a461dfd-5c61-4f18-a3af-46d00a6aa357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Flow 'volume_create_manager' (16c15537-183a-4091-8e12-06b9fc0e4a01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:28 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-8565dd57-ec85-4f71-9859-9ddbbae68dae tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Created volume successfully. Nov 06 14:36:28 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b1a2836-96f6-49f9-b106-b5fbdeabcd06 1073741824" returned: 0 in 0.474s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b1a2836-96f6-49f9-b106-b5fbdeabcd06 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:28 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b1a2836-96f6-49f9-b106-b5fbdeabcd06 Nov 06 14:36:28 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:28 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b1a2836-96f6-49f9-b106-b5fbdeabcd06" returned: 0 in 0.274s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:36:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.432s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-719630399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b05da46d-c4ee-4bc2-9847-d3e92d82471d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab7d132605447d5bee4208da5252eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:26Z,use_quota=True,user_id='d473df335996483dbbbf5c5849c7c25a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:36:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Creating volume b05da46d-c4ee-4bc2-9847-d3e92d82471d {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:36:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:29 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:29 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:36:29 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:36:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b05da46d-c4ee-4bc2-9847-d3e92d82471d 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d8095bd-685f-4008-921a-b839508a65f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b1a2836-96f6-49f9-b106-b5fbdeabcd06', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:29 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b05da46d-c4ee-4bc2-9847-d3e92d82471d 1073741824 Nov 06 14:36:29 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a13c63c-f021-4cad-bead-fd55b94cf564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:29 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Volume volume-1b1a2836-96f6-49f9-b106-b5fbdeabcd06 (1b1a2836-96f6-49f9-b106-b5fbdeabcd06): created successfully Nov 06 14:36:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a13c63c-f021-4cad-bead-fd55b94cf564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Flow 'volume_create_manager' (b70794af-25bc-42e6-a809-e33c9859873b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:29 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-1111817a-38a9-4bb8-9855-50c0010883c9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Created volume successfully. Nov 06 14:36:29 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b05da46d-c4ee-4bc2-9847-d3e92d82471d 1073741824" returned: 0 in 0.443s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b05da46d-c4ee-4bc2-9847-d3e92d82471d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:29 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b05da46d-c4ee-4bc2-9847-d3e92d82471d Nov 06 14:36:29 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:29 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b05da46d-c4ee-4bc2-9847-d3e92d82471d" returned: 0 in 0.244s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:29 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:36:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2614e514-3d5f-407e-b3f4-4b41616bda2e tempest-CinderUnicodeTest-1266181149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.876s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5759692c-fe38-4848-9a50-2b6300b68f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b05da46d-c4ee-4bc2-9847-d3e92d82471d', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9d17bb-ab56-41d1-806c-dd22fbd40a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:29 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-2614e514-3d5f-407e-b3f4-4b41616bda2e tempest-CinderUnicodeTest-1266181149 None] Creating offline snapshot f5a00da8-a5c1-492c-b813-ed93eb383b5b of volume bf7ad965-4574-4300-a4b1-e8c8a56bc3f8 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:36:29 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Volume volume-b05da46d-c4ee-4bc2-9847-d3e92d82471d (b05da46d-c4ee-4bc2-9847-d3e92d82471d): created successfully Nov 06 14:36:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9d17bb-ab56-41d1-806c-dd22fbd40a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Flow 'volume_create_manager' (258fcc4e-fa99-4f52-a3f6-53eab9d86b7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:29 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[597f3191-21d6-4198-88d3-61acdc787d3f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2614e514-3d5f-407e-b3f4-4b41616bda2e tempest-CinderUnicodeTest-1266181149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:29 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-7d02f2e0-d895-4d37-b8ba-5134d999cf99 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Created volume successfully. Nov 06 14:36:29 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8 Nov 06 14:36:29 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:30 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2614e514-3d5f-407e-b3f4-4b41616bda2e tempest-CinderUnicodeTest-1266181149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8" returned: 0 in 0.371s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2614e514-3d5f-407e-b3f4-4b41616bda2e tempest-CinderUnicodeTest-1266181149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8.f5a00da8-a5c1-492c-b813-ed93eb383b5b 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:30 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8.f5a00da8-a5c1-492c-b813-ed93eb383b5b 1G Nov 06 14:36:30 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:30 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2614e514-3d5f-407e-b3f4-4b41616bda2e tempest-CinderUnicodeTest-1266181149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8.f5a00da8-a5c1-492c-b813-ed93eb383b5b 1G" returned: 0 in 0.395s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2614e514-3d5f-407e-b3f4-4b41616bda2e tempest-CinderUnicodeTest-1266181149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8.f5a00da8-a5c1-492c-b813-ed93eb383b5b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:30 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8.f5a00da8-a5c1-492c-b813-ed93eb383b5b Nov 06 14:36:30 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-36520e5a-6275-492a-b63b-7e6dcfbee776 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "cinder-b05da46d-c4ee-4bc2-9847-d3e92d82471d-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-36520e5a-6275-492a-b63b-7e6dcfbee776 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "cinder-b05da46d-c4ee-4bc2-9847-d3e92d82471d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-36520e5a-6275-492a-b63b-7e6dcfbee776 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "cinder-quobyte-b05da46d-c4ee-4bc2-9847-d3e92d82471d" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-36520e5a-6275-492a-b63b-7e6dcfbee776 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "cinder-quobyte-b05da46d-c4ee-4bc2-9847-d3e92d82471d" acquired by "delete_volume" :: waited 0.028s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:30 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f4e582-4a2a-4fb6-88ac-53269837feb0]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-36520e5a-6275-492a-b63b-7e6dcfbee776 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b05da46d-c4ee-4bc2-9847-d3e92d82471d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:30 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2614e514-3d5f-407e-b3f4-4b41616bda2e tempest-CinderUnicodeTest-1266181149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8.f5a00da8-a5c1-492c-b813-ed93eb383b5b" returned: 0 in 0.439s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:30 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-2614e514-3d5f-407e-b3f4-4b41616bda2e tempest-CinderUnicodeTest-1266181149 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8.f5a00da8-a5c1-492c-b813-ed93eb383b5b is being set with open permissions: ugo+rw Nov 06 14:36:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2614e514-3d5f-407e-b3f4-4b41616bda2e tempest-CinderUnicodeTest-1266181149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8.f5a00da8-a5c1-492c-b813-ed93eb383b5b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:31 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8.f5a00da8-a5c1-492c-b813-ed93eb383b5b Nov 06 14:36:31 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:31 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b05da46d-c4ee-4bc2-9847-d3e92d82471d Nov 06 14:36:31 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:31 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2614e514-3d5f-407e-b3f4-4b41616bda2e tempest-CinderUnicodeTest-1266181149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8.f5a00da8-a5c1-492c-b813-ed93eb383b5b" returned: 0 in 0.284s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2614e514-3d5f-407e-b3f4-4b41616bda2e tempest-CinderUnicodeTest-1266181149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:31 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8.info Nov 06 14:36:31 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:31 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-36520e5a-6275-492a-b63b-7e6dcfbee776 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b05da46d-c4ee-4bc2-9847-d3e92d82471d" returned: 0 in 0.397s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-36520e5a-6275-492a-b63b-7e6dcfbee776 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b05da46d-c4ee-4bc2-9847-d3e92d82471d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:31 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b05da46d-c4ee-4bc2-9847-d3e92d82471d Nov 06 14:36:31 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:31 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2614e514-3d5f-407e-b3f4-4b41616bda2e tempest-CinderUnicodeTest-1266181149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8.info" returned: 0 in 0.286s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:31 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-2614e514-3d5f-407e-b3f4-4b41616bda2e tempest-CinderUnicodeTest-1266181149 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8.info is being set with open permissions: ugo+rw Nov 06 14:36:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2614e514-3d5f-407e-b3f4-4b41616bda2e tempest-CinderUnicodeTest-1266181149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:31 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:31 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8.info Nov 06 14:36:31 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-36520e5a-6275-492a-b63b-7e6dcfbee776 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b05da46d-c4ee-4bc2-9847-d3e92d82471d" returned: 0 in 0.309s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:31 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-36520e5a-6275-492a-b63b-7e6dcfbee776 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "cinder-quobyte-b05da46d-c4ee-4bc2-9847-d3e92d82471d" released by "delete_volume" :: held 0.764s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:31 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-36520e5a-6275-492a-b63b-7e6dcfbee776 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Created reservations ['f3ca0977-a6ad-4313-92a7-ad4f391011b1', 'c30349e6-26cf-4a72-8108-8cf7db47ec2c', 'a4189556-2cf2-450a-a6e3-81e9089eb1d7', '467a5c33-7304-4ede-b00f-e9b0ac6e6ce9'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-36520e5a-6275-492a-b63b-7e6dcfbee776 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-36520e5a-6275-492a-b63b-7e6dcfbee776 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:31 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-36520e5a-6275-492a-b63b-7e6dcfbee776 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:31 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-36520e5a-6275-492a-b63b-7e6dcfbee776 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-36520e5a-6275-492a-b63b-7e6dcfbee776 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-36520e5a-6275-492a-b63b-7e6dcfbee776 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:31 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:36:31 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:31 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2614e514-3d5f-407e-b3f4-4b41616bda2e tempest-CinderUnicodeTest-1266181149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8.info" returned: 0 in 0.341s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2614e514-3d5f-407e-b3f4-4b41616bda2e tempest-CinderUnicodeTest-1266181149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.251s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-20684062-a320-4a2c-9608-a6be2fdc6e42 tempest-SnapshotsActionsTest-975319395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.099s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:32 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-20684062-a320-4a2c-9608-a6be2fdc6e42 tempest-SnapshotsActionsTest-975319395 None] Creating offline snapshot de1e29a2-f1eb-45d8-bb3b-80636184ae87 of volume 982ec8aa-fbfc-4c99-b131-d0e27779b154 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:36:32 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-33ea2cad-f4bd-4d4d-85a2-576e744b44e9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "cinder-1b1a2836-96f6-49f9-b106-b5fbdeabcd06-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:32 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8caccfa-9110-4952-a723-fadba1e7cb63]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:32 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-2614e514-3d5f-407e-b3f4-4b41616bda2e tempest-CinderUnicodeTest-1266181149 None] Create snapshot completed successfully Nov 06 14:36:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-20684062-a320-4a2c-9608-a6be2fdc6e42 tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:32 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-33ea2cad-f4bd-4d4d-85a2-576e744b44e9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "cinder-1b1a2836-96f6-49f9-b106-b5fbdeabcd06-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:32 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-36520e5a-6275-492a-b63b-7e6dcfbee776 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.340s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:32 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-36520e5a-6275-492a-b63b-7e6dcfbee776 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:36:32 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-36520e5a-6275-492a-b63b-7e6dcfbee776 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Deleted volume successfully. Nov 06 14:36:32 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-33ea2cad-f4bd-4d4d-85a2-576e744b44e9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "cinder-quobyte-1b1a2836-96f6-49f9-b106-b5fbdeabcd06" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:32 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-36520e5a-6275-492a-b63b-7e6dcfbee776 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "cinder-b05da46d-c4ee-4bc2-9847-d3e92d82471d-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:32 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-33ea2cad-f4bd-4d4d-85a2-576e744b44e9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "cinder-quobyte-1b1a2836-96f6-49f9-b106-b5fbdeabcd06" acquired by "delete_volume" :: waited 0.026s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:32 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc7e298-47ca-41ef-aef7-79a1db3cc879]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-33ea2cad-f4bd-4d4d-85a2-576e744b44e9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b1a2836-96f6-49f9-b106-b5fbdeabcd06 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:32 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee Nov 06 14:36:32 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:32 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b1a2836-96f6-49f9-b106-b5fbdeabcd06 Nov 06 14:36:32 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:32 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-20684062-a320-4a2c-9608-a6be2fdc6e42 tempest-SnapshotsActionsTest-975319395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee" returned: 0 in 0.449s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:32 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-20684062-a320-4a2c-9608-a6be2fdc6e42 tempest-SnapshotsActionsTest-975319395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-982ec8aa-fbfc-4c99-b131-d0e27779b154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:36:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-20684062-a320-4a2c-9608-a6be2fdc6e42 tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.de1e29a2-f1eb-45d8-bb3b-80636184ae87 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:32 devstack sudo[99286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.de1e29a2-f1eb-45d8-bb3b-80636184ae87 1G Nov 06 14:36:32 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:32 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-33ea2cad-f4bd-4d4d-85a2-576e744b44e9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b1a2836-96f6-49f9-b106-b5fbdeabcd06" returned: 0 in 0.391s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-33ea2cad-f4bd-4d4d-85a2-576e744b44e9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b1a2836-96f6-49f9-b106-b5fbdeabcd06 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:32 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b1a2836-96f6-49f9-b106-b5fbdeabcd06 Nov 06 14:36:32 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:32 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-33ea2cad-f4bd-4d4d-85a2-576e744b44e9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b1a2836-96f6-49f9-b106-b5fbdeabcd06" returned: 0 in 0.290s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:32 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-33ea2cad-f4bd-4d4d-85a2-576e744b44e9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "cinder-quobyte-1b1a2836-96f6-49f9-b106-b5fbdeabcd06" released by "delete_volume" :: held 0.739s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-33ea2cad-f4bd-4d4d-85a2-576e744b44e9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Created reservations ['32a31741-afb3-4bb4-8659-9ea14150991f', '63d1d7d0-07e3-4dd7-bbfd-44bab1794d98', '5b1942ab-0f37-4a46-abe0-0f45e6d9ddbc', '20d154f3-bf77-439e-9e11-8bbc34237e6c'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:33 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-20684062-a320-4a2c-9608-a6be2fdc6e42 tempest-SnapshotsActionsTest-975319395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.de1e29a2-f1eb-45d8-bb3b-80636184ae87 1G" returned: 0 in 0.538s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-20684062-a320-4a2c-9608-a6be2fdc6e42 tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.de1e29a2-f1eb-45d8-bb3b-80636184ae87 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-5b5f24eb-5e06-4b52-a0cd-a84a5a0567cc tempest-CinderUnicodeTest-1266181149 None] Acquiring lock "cinder-f5a00da8-a5c1-492c-b813-ed93eb383b5b-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-33ea2cad-f4bd-4d4d-85a2-576e744b44e9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-33ea2cad-f4bd-4d4d-85a2-576e744b44e9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:33 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.de1e29a2-f1eb-45d8-bb3b-80636184ae87 Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-33ea2cad-f4bd-4d4d-85a2-576e744b44e9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:33 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-33ea2cad-f4bd-4d4d-85a2-576e744b44e9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-33ea2cad-f4bd-4d4d-85a2-576e744b44e9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-33ea2cad-f4bd-4d4d-85a2-576e744b44e9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-5b5f24eb-5e06-4b52-a0cd-a84a5a0567cc tempest-CinderUnicodeTest-1266181149 None] Lock "cinder-f5a00da8-a5c1-492c-b813-ed93eb383b5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-5b5f24eb-5e06-4b52-a0cd-a84a5a0567cc tempest-CinderUnicodeTest-1266181149 None] Acquiring lock "cinder-quobyte-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-5b5f24eb-5e06-4b52-a0cd-a84a5a0567cc tempest-CinderUnicodeTest-1266181149 None] Lock "cinder-quobyte-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-5b5f24eb-5e06-4b52-a0cd-a84a5a0567cc tempest-CinderUnicodeTest-1266181149 None] Acquiring lock "cinder-quobyte-f5a00da8-a5c1-492c-b813-ed93eb383b5b" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:33 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:36:33 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-5b5f24eb-5e06-4b52-a0cd-a84a5a0567cc tempest-CinderUnicodeTest-1266181149 None] Lock "cinder-quobyte-f5a00da8-a5c1-492c-b813-ed93eb383b5b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-5b5f24eb-5e06-4b52-a0cd-a84a5a0567cc tempest-CinderUnicodeTest-1266181149 None] Deleting offline snapshot f5a00da8-a5c1-492c-b813-ed93eb383b5b of volume bf7ad965-4574-4300-a4b1-e8c8a56bc3f8 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-5b5f24eb-5e06-4b52-a0cd-a84a5a0567cc tempest-CinderUnicodeTest-1266181149 None] snapshot_file for this snap is: volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8.f5a00da8-a5c1-492c-b813-ed93eb383b5b {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ceafc7-190f-44e6-8345-ff50580ec702]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5b5f24eb-5e06-4b52-a0cd-a84a5a0567cc tempest-CinderUnicodeTest-1266181149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8.f5a00da8-a5c1-492c-b813-ed93eb383b5b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1eb2f955-47ab-4cbe-a090-1167c8257cf8 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "cinder-57b746e5-aa12-4c9d-98bd-6232c302f402-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1eb2f955-47ab-4cbe-a090-1167c8257cf8 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "cinder-57b746e5-aa12-4c9d-98bd-6232c302f402-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1eb2f955-47ab-4cbe-a090-1167c8257cf8 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "cinder-quobyte-57b746e5-aa12-4c9d-98bd-6232c302f402" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1eb2f955-47ab-4cbe-a090-1167c8257cf8 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "cinder-quobyte-57b746e5-aa12-4c9d-98bd-6232c302f402" acquired by "delete_volume" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[523c015f-6667-44c4-92ea-8b54250149f7]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1eb2f955-47ab-4cbe-a090-1167c8257cf8 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-57b746e5-aa12-4c9d-98bd-6232c302f402 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:33 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8.f5a00da8-a5c1-492c-b813-ed93eb383b5b Nov 06 14:36:33 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:33 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-33ea2cad-f4bd-4d4d-85a2-576e744b44e9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.476s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-33ea2cad-f4bd-4d4d-85a2-576e744b44e9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:36:33 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-20684062-a320-4a2c-9608-a6be2fdc6e42 tempest-SnapshotsActionsTest-975319395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.de1e29a2-f1eb-45d8-bb3b-80636184ae87" returned: 0 in 0.549s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:33 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-20684062-a320-4a2c-9608-a6be2fdc6e42 tempest-SnapshotsActionsTest-975319395 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.de1e29a2-f1eb-45d8-bb3b-80636184ae87 is being set with open permissions: ugo+rw Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-20684062-a320-4a2c-9608-a6be2fdc6e42 tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.de1e29a2-f1eb-45d8-bb3b-80636184ae87 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:33 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-33ea2cad-f4bd-4d4d-85a2-576e744b44e9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Deleted volume successfully. Nov 06 14:36:33 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-57b746e5-aa12-4c9d-98bd-6232c302f402 Nov 06 14:36:33 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:33 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.de1e29a2-f1eb-45d8-bb3b-80636184ae87 Nov 06 14:36:33 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-33ea2cad-f4bd-4d4d-85a2-576e744b44e9 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "cinder-1b1a2836-96f6-49f9-b106-b5fbdeabcd06-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:33 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5b5f24eb-5e06-4b52-a0cd-a84a5a0567cc tempest-CinderUnicodeTest-1266181149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8.f5a00da8-a5c1-492c-b813-ed93eb383b5b" returned: 0 in 0.602s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-5b5f24eb-5e06-4b52-a0cd-a84a5a0567cc tempest-CinderUnicodeTest-1266181149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[b263bd5d-9676-42cf-bb74-8d0c185d747c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5b5f24eb-5e06-4b52-a0cd-a84a5a0567cc tempest-CinderUnicodeTest-1266181149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:33 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1eb2f955-47ab-4cbe-a090-1167c8257cf8 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-57b746e5-aa12-4c9d-98bd-6232c302f402" returned: 0 in 0.459s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1eb2f955-47ab-4cbe-a090-1167c8257cf8 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-57b746e5-aa12-4c9d-98bd-6232c302f402 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:34 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-20684062-a320-4a2c-9608-a6be2fdc6e42 tempest-SnapshotsActionsTest-975319395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.de1e29a2-f1eb-45d8-bb3b-80636184ae87" returned: 0 in 0.357s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:34 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-57b746e5-aa12-4c9d-98bd-6232c302f402 Nov 06 14:36:34 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-20684062-a320-4a2c-9608-a6be2fdc6e42 tempest-SnapshotsActionsTest-975319395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.072s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:34 devstack sudo[99321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8 Nov 06 14:36:34 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:34 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-20684062-a320-4a2c-9608-a6be2fdc6e42 tempest-SnapshotsActionsTest-975319395 None] Create snapshot completed successfully Nov 06 14:36:34 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1eb2f955-47ab-4cbe-a090-1167c8257cf8 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-57b746e5-aa12-4c9d-98bd-6232c302f402" returned: 0 in 0.297s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:34 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1eb2f955-47ab-4cbe-a090-1167c8257cf8 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "cinder-quobyte-57b746e5-aa12-4c9d-98bd-6232c302f402" released by "delete_volume" :: held 0.823s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:34 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-1eb2f955-47ab-4cbe-a090-1167c8257cf8 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Created reservations ['a5514ef4-5e71-43be-b0b2-09609ebadd5d', '0347c24e-2375-4bf9-89d7-1b5529d764e7', '35421306-d1dc-4a3e-b5b7-5884b3356296', '9edfd82f-3231-489d-9fdc-d517e97043de'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:34 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5b5f24eb-5e06-4b52-a0cd-a84a5a0567cc tempest-CinderUnicodeTest-1266181149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8" returned: 0 in 0.445s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5b5f24eb-5e06-4b52-a0cd-a84a5a0567cc tempest-CinderUnicodeTest-1266181149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8.f5a00da8-a5c1-492c-b813-ed93eb383b5b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1eb2f955-47ab-4cbe-a090-1167c8257cf8 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1eb2f955-47ab-4cbe-a090-1167c8257cf8 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:34 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1eb2f955-47ab-4cbe-a090-1167c8257cf8 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:34 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8.f5a00da8-a5c1-492c-b813-ed93eb383b5b Nov 06 14:36:34 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:34 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1eb2f955-47ab-4cbe-a090-1167c8257cf8 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1eb2f955-47ab-4cbe-a090-1167c8257cf8 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1eb2f955-47ab-4cbe-a090-1167c8257cf8 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:34 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:36:34 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:34 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7bff0ba1-7365-4d7c-b973-18cd7172928f tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "cinder-c846931c-00db-40e7-a7f9-f4454c1ec271-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:34 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7bff0ba1-7365-4d7c-b973-18cd7172928f tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "cinder-c846931c-00db-40e7-a7f9-f4454c1ec271-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:34 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7bff0ba1-7365-4d7c-b973-18cd7172928f tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "cinder-quobyte-c846931c-00db-40e7-a7f9-f4454c1ec271" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:34 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7bff0ba1-7365-4d7c-b973-18cd7172928f tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "cinder-quobyte-c846931c-00db-40e7-a7f9-f4454c1ec271" acquired by "delete_volume" :: waited 0.024s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:34 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0e4283-82ca-4035-b962-6e7ab75778c0]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7bff0ba1-7365-4d7c-b973-18cd7172928f tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c846931c-00db-40e7-a7f9-f4454c1ec271 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:34 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1eb2f955-47ab-4cbe-a090-1167c8257cf8 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.324s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:34 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-1eb2f955-47ab-4cbe-a090-1167c8257cf8 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:36:34 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-1eb2f955-47ab-4cbe-a090-1167c8257cf8 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Deleted volume successfully. Nov 06 14:36:34 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1eb2f955-47ab-4cbe-a090-1167c8257cf8 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "cinder-57b746e5-aa12-4c9d-98bd-6232c302f402-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:34 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5b5f24eb-5e06-4b52-a0cd-a84a5a0567cc tempest-CinderUnicodeTest-1266181149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8.f5a00da8-a5c1-492c-b813-ed93eb383b5b" returned: 0 in 0.460s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:34 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c846931c-00db-40e7-a7f9-f4454c1ec271 Nov 06 14:36:34 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5b5f24eb-5e06-4b52-a0cd-a84a5a0567cc tempest-CinderUnicodeTest-1266181149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8.f5a00da8-a5c1-492c-b813-ed93eb383b5b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:34 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8.f5a00da8-a5c1-492c-b813-ed93eb383b5b Nov 06 14:36:34 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:35 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5b5f24eb-5e06-4b52-a0cd-a84a5a0567cc tempest-CinderUnicodeTest-1266181149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8.f5a00da8-a5c1-492c-b813-ed93eb383b5b" returned: 0 in 0.264s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:35 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7bff0ba1-7365-4d7c-b973-18cd7172928f tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c846931c-00db-40e7-a7f9-f4454c1ec271" returned: 0 in 0.407s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7bff0ba1-7365-4d7c-b973-18cd7172928f tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c846931c-00db-40e7-a7f9-f4454c1ec271 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:35 devstack sudo[99346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c846931c-00db-40e7-a7f9-f4454c1ec271 Nov 06 14:36:35 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-5b5f24eb-5e06-4b52-a0cd-a84a5a0567cc tempest-CinderUnicodeTest-1266181149 None] Lock "cinder-quobyte-f5a00da8-a5c1-492c-b813-ed93eb383b5b" released by "_delete_snapshot" :: held 1.975s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-5b5f24eb-5e06-4b52-a0cd-a84a5a0567cc tempest-CinderUnicodeTest-1266181149 None] Lock "cinder-quobyte-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8" released by "delete_snapshot" :: held 2.012s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-5b5f24eb-5e06-4b52-a0cd-a84a5a0567cc tempest-CinderUnicodeTest-1266181149 None] Created reservations ['60007a97-2c0d-4e01-bba9-ee3997ccaab8', 'fe9b6d97-d680-43e7-a8c9-596dc167ebcc', 'b9082bc7-5d0d-46fd-a629-59f48fae6e7f', '100d8c48-30f5-484e-99bd-93d178900a46'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:35 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-5b5f24eb-5e06-4b52-a0cd-a84a5a0567cc tempest-CinderUnicodeTest-1266181149 None] Delete snapshot completed successfully. Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ce3922da-30eb-4dd6-8aa5-5cae6185efd7 tempest-SnapshotsActionsTest-893473510 None] Acquiring lock "cinder-de1e29a2-f1eb-45d8-bb3b-80636184ae87-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-5b5f24eb-5e06-4b52-a0cd-a84a5a0567cc tempest-CinderUnicodeTest-1266181149 None] Lock "cinder-f5a00da8-a5c1-492c-b813-ed93eb383b5b-delete_snapshot" released by "delete_snapshot" :: held 2.238s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ce3922da-30eb-4dd6-8aa5-5cae6185efd7 tempest-SnapshotsActionsTest-893473510 None] Lock "cinder-de1e29a2-f1eb-45d8-bb3b-80636184ae87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ce3922da-30eb-4dd6-8aa5-5cae6185efd7 tempest-SnapshotsActionsTest-893473510 None] Acquiring lock "cinder-quobyte-982ec8aa-fbfc-4c99-b131-d0e27779b154" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:35 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ce3922da-30eb-4dd6-8aa5-5cae6185efd7 tempest-SnapshotsActionsTest-893473510 None] Lock "cinder-quobyte-982ec8aa-fbfc-4c99-b131-d0e27779b154" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ce3922da-30eb-4dd6-8aa5-5cae6185efd7 tempest-SnapshotsActionsTest-893473510 None] Acquiring lock "cinder-quobyte-de1e29a2-f1eb-45d8-bb3b-80636184ae87" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7bff0ba1-7365-4d7c-b973-18cd7172928f tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c846931c-00db-40e7-a7f9-f4454c1ec271" returned: 0 in 0.322s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ce3922da-30eb-4dd6-8aa5-5cae6185efd7 tempest-SnapshotsActionsTest-893473510 None] Lock "cinder-quobyte-de1e29a2-f1eb-45d8-bb3b-80636184ae87" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-ce3922da-30eb-4dd6-8aa5-5cae6185efd7 tempest-SnapshotsActionsTest-893473510 None] Deleting offline snapshot de1e29a2-f1eb-45d8-bb3b-80636184ae87 of volume 982ec8aa-fbfc-4c99-b131-d0e27779b154 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-ce3922da-30eb-4dd6-8aa5-5cae6185efd7 tempest-SnapshotsActionsTest-893473510 None] snapshot_file for this snap is: volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.de1e29a2-f1eb-45d8-bb3b-80636184ae87 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7bff0ba1-7365-4d7c-b973-18cd7172928f tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "cinder-quobyte-c846931c-00db-40e7-a7f9-f4454c1ec271" released by "delete_volume" :: held 0.812s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[81737372-3bb7-442f-9105-1f3821c0a09d]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ce3922da-30eb-4dd6-8aa5-5cae6185efd7 tempest-SnapshotsActionsTest-893473510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.de1e29a2-f1eb-45d8-bb3b-80636184ae87 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-7bff0ba1-7365-4d7c-b973-18cd7172928f tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Created reservations ['9be10d9a-a2f4-4e33-849e-11c3ae018f8f', 'ac1d860a-008a-47d9-a143-0a47cb7d6025', '7d1a7a83-8d02-4dc7-bc41-aadd2de0cf60', '5ee4a6f7-2c22-4b67-bf82-39beb6774011'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Flow 'volume_create_manager' (6f420253-c84a-45f7-a2f4-b8c8e3f06161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:35 devstack sudo[99349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.de1e29a2-f1eb-45d8-bb3b-80636184ae87 Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b535b6b2-64aa-41f5-8e58-b7753bdba21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:35 devstack sudo[99349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b535b6b2-64aa-41f5-8e58-b7753bdba21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1381736991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c84776de-d810-48fa-9491-56817a9b202e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3644483992fa430badea77a31b621917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:36Z,use_quota=True,user_id='38ae9fe9638248d496bd4ece5b977674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b13fef-5412-45f9-b500-2478dd1ef52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b13fef-5412-45f9-b500-2478dd1ef52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bae7a9f-af11-44a5-919c-4892f6402206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bae7a9f-af11-44a5-919c-4892f6402206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c84776de-d810-48fa-9491-56817a9b202e', 'volume_name': 'volume-c84776de-d810-48fa-9491-56817a9b202e', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4008fa80-2d78-4b75-95ec-50a457cfdeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4008fa80-2d78-4b75-95ec-50a457cfdeab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b294e1-6ec7-4de0-b450-fa15ecd55fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:35 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Volume c84776de-d810-48fa-9491-56817a9b202e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c84776de-d810-48fa-9491-56817a9b202e', 'volume_size': 1} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1381736991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c84776de-d810-48fa-9491-56817a9b202e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3644483992fa430badea77a31b621917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:36Z,use_quota=True,user_id='38ae9fe9638248d496bd4ece5b977674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Creating volume c84776de-d810-48fa-9491-56817a9b202e {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:36:35 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:35 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e 1073741824 Nov 06 14:36:35 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7bff0ba1-7365-4d7c-b973-18cd7172928f tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7bff0ba1-7365-4d7c-b973-18cd7172928f tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7bff0ba1-7365-4d7c-b973-18cd7172928f tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7bff0ba1-7365-4d7c-b973-18cd7172928f tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7bff0ba1-7365-4d7c-b973-18cd7172928f tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7bff0ba1-7365-4d7c-b973-18cd7172928f tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-56073b80-4626-4955-9453-10918753fd2c tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "cinder-3608f6c0-0609-4f9c-b941-1ad1001bfd9f-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:35 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-56073b80-4626-4955-9453-10918753fd2c tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "cinder-3608f6c0-0609-4f9c-b941-1ad1001bfd9f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:35 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-56073b80-4626-4955-9453-10918753fd2c tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "cinder-quobyte-3608f6c0-0609-4f9c-b941-1ad1001bfd9f" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-56073b80-4626-4955-9453-10918753fd2c tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "cinder-quobyte-3608f6c0-0609-4f9c-b941-1ad1001bfd9f" acquired by "delete_volume" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[2020d124-46f3-4c10-937b-4dda5c9765a1]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-56073b80-4626-4955-9453-10918753fd2c tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3608f6c0-0609-4f9c-b941-1ad1001bfd9f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:36 devstack sudo[99349]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ce3922da-30eb-4dd6-8aa5-5cae6185efd7 tempest-SnapshotsActionsTest-893473510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.de1e29a2-f1eb-45d8-bb3b-80636184ae87" returned: 0 in 0.466s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-ce3922da-30eb-4dd6-8aa5-5cae6185efd7 tempest-SnapshotsActionsTest-893473510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-982ec8aa-fbfc-4c99-b131-d0e27779b154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b8e6d3-13f1-4a40-ac5e-f37630bce31d]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ce3922da-30eb-4dd6-8aa5-5cae6185efd7 tempest-SnapshotsActionsTest-893473510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:36 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3608f6c0-0609-4f9c-b941-1ad1001bfd9f Nov 06 14:36:36 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:36 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee Nov 06 14:36:36 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:36 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7bff0ba1-7365-4d7c-b973-18cd7172928f tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.365s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-7bff0ba1-7365-4d7c-b973-18cd7172928f tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:36:36 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-7bff0ba1-7365-4d7c-b973-18cd7172928f tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Deleted volume successfully. Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7bff0ba1-7365-4d7c-b973-18cd7172928f tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "cinder-c846931c-00db-40e7-a7f9-f4454c1ec271-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:36 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e 1073741824" returned: 0 in 0.536s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:36 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e Nov 06 14:36:36 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:36 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-90f24da6-d6b2-4630-b903-559642327e9a tempest-CinderUnicodeTest-1266181149 None] Acquiring lock "cinder-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-56073b80-4626-4955-9453-10918753fd2c tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3608f6c0-0609-4f9c-b941-1ad1001bfd9f" returned: 0 in 0.441s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-56073b80-4626-4955-9453-10918753fd2c tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3608f6c0-0609-4f9c-b941-1ad1001bfd9f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-90f24da6-d6b2-4630-b903-559642327e9a tempest-CinderUnicodeTest-1266181149 None] Lock "cinder-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:36 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3608f6c0-0609-4f9c-b941-1ad1001bfd9f Nov 06 14:36:36 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-90f24da6-d6b2-4630-b903-559642327e9a tempest-CinderUnicodeTest-1266181149 None] Acquiring lock "cinder-quobyte-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-90f24da6-d6b2-4630-b903-559642327e9a tempest-CinderUnicodeTest-1266181149 None] Lock "cinder-quobyte-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8" acquired by "delete_volume" :: waited 0.028s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:36 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ce3922da-30eb-4dd6-8aa5-5cae6185efd7 tempest-SnapshotsActionsTest-893473510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee" returned: 0 in 0.536s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-ce3922da-30eb-4dd6-8aa5-5cae6185efd7 tempest-SnapshotsActionsTest-893473510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-982ec8aa-fbfc-4c99-b131-d0e27779b154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ce3922da-30eb-4dd6-8aa5-5cae6185efd7 tempest-SnapshotsActionsTest-893473510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.de1e29a2-f1eb-45d8-bb3b-80636184ae87 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[184fd7c4-2424-4829-8484-f1429a58d4a4]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-90f24da6-d6b2-4630-b903-559642327e9a tempest-CinderUnicodeTest-1266181149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:36 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.de1e29a2-f1eb-45d8-bb3b-80636184ae87 Nov 06 14:36:36 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:36 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e" returned: 0 in 0.335s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b294e1-6ec7-4de0-b450-fa15ecd55fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c84776de-d810-48fa-9491-56817a9b202e', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c753042-245e-447c-8270-f9fe111a6f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:36 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Volume volume-c84776de-d810-48fa-9491-56817a9b202e (c84776de-d810-48fa-9491-56817a9b202e): created successfully Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c753042-245e-447c-8270-f9fe111a6f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Flow 'volume_create_manager' (6f420253-c84a-45f7-a2f4-b8c8e3f06161) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:36 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8 Nov 06 14:36:36 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:36 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-810cfe66-9149-4eed-8769-46f775408cf3 req-93f7ac4e-f9ec-4fa9-be30-2e2431323cc8 tempest-VolumesSnapshotsTestJSON-968795300 None] Created volume successfully. Nov 06 14:36:36 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-56073b80-4626-4955-9453-10918753fd2c tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3608f6c0-0609-4f9c-b941-1ad1001bfd9f" returned: 0 in 0.345s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-56073b80-4626-4955-9453-10918753fd2c tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "cinder-quobyte-3608f6c0-0609-4f9c-b941-1ad1001bfd9f" released by "delete_volume" :: held 0.846s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-56073b80-4626-4955-9453-10918753fd2c tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Created reservations ['928cb405-a3bd-493e-9be9-aea8460112dc', 'ca8205a1-d304-49bc-a8bb-06fe8e454763', '522f03c5-308f-4927-a697-40d52db25f35', '6011160f-0af6-410c-8a4c-7eeca1c4d0a1'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-56073b80-4626-4955-9453-10918753fd2c tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-56073b80-4626-4955-9453-10918753fd2c tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-56073b80-4626-4955-9453-10918753fd2c tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-56073b80-4626-4955-9453-10918753fd2c tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-56073b80-4626-4955-9453-10918753fd2c tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-56073b80-4626-4955-9453-10918753fd2c tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:36 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:36:36 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:37 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-615e8a7d-a0f2-497f-9f52-60340269b066 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "cinder-fab77ad0-10b3-42ba-a198-fcfb46344039-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-90f24da6-d6b2-4630-b903-559642327e9a tempest-CinderUnicodeTest-1266181149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8" returned: 0 in 0.443s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-90f24da6-d6b2-4630-b903-559642327e9a tempest-CinderUnicodeTest-1266181149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:37 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ce3922da-30eb-4dd6-8aa5-5cae6185efd7 tempest-SnapshotsActionsTest-893473510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.de1e29a2-f1eb-45d8-bb3b-80636184ae87" returned: 0 in 0.494s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ce3922da-30eb-4dd6-8aa5-5cae6185efd7 tempest-SnapshotsActionsTest-893473510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.de1e29a2-f1eb-45d8-bb3b-80636184ae87 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:37 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8 Nov 06 14:36:37 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-615e8a7d-a0f2-497f-9f52-60340269b066 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "cinder-fab77ad0-10b3-42ba-a198-fcfb46344039-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:37 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.de1e29a2-f1eb-45d8-bb3b-80636184ae87 Nov 06 14:36:37 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-615e8a7d-a0f2-497f-9f52-60340269b066 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "cinder-quobyte-fab77ad0-10b3-42ba-a198-fcfb46344039" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-615e8a7d-a0f2-497f-9f52-60340269b066 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "cinder-quobyte-fab77ad0-10b3-42ba-a198-fcfb46344039" acquired by "delete_volume" :: waited 0.019s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:37 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-56073b80-4626-4955-9453-10918753fd2c tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.310s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-56073b80-4626-4955-9453-10918753fd2c tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:36:37 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-56073b80-4626-4955-9453-10918753fd2c tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Deleted volume successfully. Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[57300ff7-7f37-48e9-bb4a-cc50c26dacc7]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-615e8a7d-a0f2-497f-9f52-60340269b066 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fab77ad0-10b3-42ba-a198-fcfb46344039 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-56073b80-4626-4955-9453-10918753fd2c tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "cinder-3608f6c0-0609-4f9c-b941-1ad1001bfd9f-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:37 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-90f24da6-d6b2-4630-b903-559642327e9a tempest-CinderUnicodeTest-1266181149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8" returned: 0 in 0.296s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:37 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fab77ad0-10b3-42ba-a198-fcfb46344039 Nov 06 14:36:37 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:37 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-90f24da6-d6b2-4630-b903-559642327e9a tempest-CinderUnicodeTest-1266181149 None] Lock "cinder-quobyte-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8" released by "delete_volume" :: held 0.846s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ce3922da-30eb-4dd6-8aa5-5cae6185efd7 tempest-SnapshotsActionsTest-893473510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.de1e29a2-f1eb-45d8-bb3b-80636184ae87" returned: 0 in 0.303s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ce3922da-30eb-4dd6-8aa5-5cae6185efd7 tempest-SnapshotsActionsTest-893473510 None] Lock "cinder-quobyte-de1e29a2-f1eb-45d8-bb3b-80636184ae87" released by "_delete_snapshot" :: held 1.915s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ce3922da-30eb-4dd6-8aa5-5cae6185efd7 tempest-SnapshotsActionsTest-893473510 None] Lock "cinder-quobyte-982ec8aa-fbfc-4c99-b131-d0e27779b154" released by "delete_snapshot" :: held 1.957s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-90f24da6-d6b2-4630-b903-559642327e9a tempest-CinderUnicodeTest-1266181149 None] Created reservations ['3fd46c23-cd61-4254-b88e-989895d4da4f', '3cfaaee8-6e62-4e44-8854-961dd11f3c16', 'c932c479-58e0-4f6f-b39f-7ea43f510fe7', 'e3d5c7bf-8732-4248-b835-0a2af94558a5'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-ce3922da-30eb-4dd6-8aa5-5cae6185efd7 tempest-SnapshotsActionsTest-893473510 None] Created reservations ['9fa45c15-f758-4db2-bc04-78f8e9f73d05', '5f601c6e-6aed-4c05-ae14-2e20e085cccb', 'c40d4262-a260-428c-81c7-5276c3aed630', '8dcec4f9-82f7-4ed8-b138-e0379b47667b'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-90f24da6-d6b2-4630-b903-559642327e9a tempest-CinderUnicodeTest-1266181149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-90f24da6-d6b2-4630-b903-559642327e9a tempest-CinderUnicodeTest-1266181149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-90f24da6-d6b2-4630-b903-559642327e9a tempest-CinderUnicodeTest-1266181149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-90f24da6-d6b2-4630-b903-559642327e9a tempest-CinderUnicodeTest-1266181149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-90f24da6-d6b2-4630-b903-559642327e9a tempest-CinderUnicodeTest-1266181149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-90f24da6-d6b2-4630-b903-559642327e9a tempest-CinderUnicodeTest-1266181149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:37 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:36:37 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-638bbd44-1a04-4939-b9d0-b4853bb90829 tempest-CinderUnicodeTest-1266181149 None] Acquiring lock "cinder-e467e467-2e99-4d27-9b3e-af4882a2e159-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:37 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-ce3922da-30eb-4dd6-8aa5-5cae6185efd7 tempest-SnapshotsActionsTest-893473510 None] Delete snapshot completed successfully. Nov 06 14:36:37 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-615e8a7d-a0f2-497f-9f52-60340269b066 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fab77ad0-10b3-42ba-a198-fcfb46344039" returned: 0 in 0.463s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ce3922da-30eb-4dd6-8aa5-5cae6185efd7 tempest-SnapshotsActionsTest-893473510 None] Lock "cinder-de1e29a2-f1eb-45d8-bb3b-80636184ae87-delete_snapshot" released by "delete_snapshot" :: held 2.244s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-615e8a7d-a0f2-497f-9f52-60340269b066 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fab77ad0-10b3-42ba-a198-fcfb46344039 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-638bbd44-1a04-4939-b9d0-b4853bb90829 tempest-CinderUnicodeTest-1266181149 None] Lock "cinder-e467e467-2e99-4d27-9b3e-af4882a2e159-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:37 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fab77ad0-10b3-42ba-a198-fcfb46344039 Nov 06 14:36:37 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-638bbd44-1a04-4939-b9d0-b4853bb90829 tempest-CinderUnicodeTest-1266181149 None] Acquiring lock "cinder-quobyte-e467e467-2e99-4d27-9b3e-af4882a2e159" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-638bbd44-1a04-4939-b9d0-b4853bb90829 tempest-CinderUnicodeTest-1266181149 None] Lock "cinder-quobyte-e467e467-2e99-4d27-9b3e-af4882a2e159" acquired by "delete_volume" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c1ca09-5515-459a-990b-2e883ce0be50]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-638bbd44-1a04-4939-b9d0-b4853bb90829 tempest-CinderUnicodeTest-1266181149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e467e467-2e99-4d27-9b3e-af4882a2e159 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:37 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-90f24da6-d6b2-4630-b903-559642327e9a tempest-CinderUnicodeTest-1266181149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.371s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-90f24da6-d6b2-4630-b903-559642327e9a tempest-CinderUnicodeTest-1266181149 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:36:37 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e467e467-2e99-4d27-9b3e-af4882a2e159 Nov 06 14:36:37 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:37 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-90f24da6-d6b2-4630-b903-559642327e9a tempest-CinderUnicodeTest-1266181149 None] Deleted volume successfully. Nov 06 14:36:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-90f24da6-d6b2-4630-b903-559642327e9a tempest-CinderUnicodeTest-1266181149 None] Lock "cinder-bf7ad965-4574-4300-a4b1-e8c8a56bc3f8-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:38 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-615e8a7d-a0f2-497f-9f52-60340269b066 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fab77ad0-10b3-42ba-a198-fcfb46344039" returned: 0 in 0.368s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-615e8a7d-a0f2-497f-9f52-60340269b066 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "cinder-quobyte-fab77ad0-10b3-42ba-a198-fcfb46344039" released by "delete_volume" :: held 0.901s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-cbf17990-cd03-4363-bab1-1a8591447d99 req-27baece1-cb06-4652-9223-a066abe5ae89 tempest-VolumesSnapshotsTestJSON-968795300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-cbf17990-cd03-4363-bab1-1a8591447d99 req-27baece1-cb06-4652-9223-a066abe5ae89 tempest-VolumesSnapshotsTestJSON-968795300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [req-cbf17990-cd03-4363-bab1-1a8591447d99 req-27baece1-cb06-4652-9223-a066abe5ae89 tempest-VolumesSnapshotsTestJSON-968795300 None] Creating offline snapshot c1216242-2f6f-43d0-a3cd-6180cf1ba3fb of volume c84776de-d810-48fa-9491-56817a9b202e {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[173851f6-646d-4a49-8166-d24442d40718]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-cbf17990-cd03-4363-bab1-1a8591447d99 req-27baece1-cb06-4652-9223-a066abe5ae89 tempest-VolumesSnapshotsTestJSON-968795300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-615e8a7d-a0f2-497f-9f52-60340269b066 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Created reservations ['1e4247d4-b0e5-4e89-93cb-fda5fc59868c', '60efc279-19fb-4377-a6fd-f22aacddccb1', '3f35a907-cf9d-42da-9f9c-ff2d6ee79927', '42fbe49e-1184-470a-88be-faca1efaa009'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:38 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-638bbd44-1a04-4939-b9d0-b4853bb90829 tempest-CinderUnicodeTest-1266181149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e467e467-2e99-4d27-9b3e-af4882a2e159" returned: 0 in 0.495s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-638bbd44-1a04-4939-b9d0-b4853bb90829 tempest-CinderUnicodeTest-1266181149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e467e467-2e99-4d27-9b3e-af4882a2e159 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:38 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e Nov 06 14:36:38 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:38 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e467e467-2e99-4d27-9b3e-af4882a2e159 Nov 06 14:36:38 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-615e8a7d-a0f2-497f-9f52-60340269b066 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-615e8a7d-a0f2-497f-9f52-60340269b066 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-615e8a7d-a0f2-497f-9f52-60340269b066 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-615e8a7d-a0f2-497f-9f52-60340269b066 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-615e8a7d-a0f2-497f-9f52-60340269b066 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-615e8a7d-a0f2-497f-9f52-60340269b066 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:38 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:36:38 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:38 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-638bbd44-1a04-4939-b9d0-b4853bb90829 tempest-CinderUnicodeTest-1266181149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e467e467-2e99-4d27-9b3e-af4882a2e159" returned: 0 in 0.264s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-638bbd44-1a04-4939-b9d0-b4853bb90829 tempest-CinderUnicodeTest-1266181149 None] Lock "cinder-quobyte-e467e467-2e99-4d27-9b3e-af4882a2e159" released by "delete_volume" :: held 0.807s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:38 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-cbf17990-cd03-4363-bab1-1a8591447d99 req-27baece1-cb06-4652-9223-a066abe5ae89 tempest-VolumesSnapshotsTestJSON-968795300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e" returned: 0 in 0.446s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-cbf17990-cd03-4363-bab1-1a8591447d99 req-27baece1-cb06-4652-9223-a066abe5ae89 tempest-VolumesSnapshotsTestJSON-968795300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e.c1216242-2f6f-43d0-a3cd-6180cf1ba3fb 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:38 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e.c1216242-2f6f-43d0-a3cd-6180cf1ba3fb 1G Nov 06 14:36:38 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:38 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-615e8a7d-a0f2-497f-9f52-60340269b066 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.276s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-615e8a7d-a0f2-497f-9f52-60340269b066 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:36:38 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-615e8a7d-a0f2-497f-9f52-60340269b066 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Deleted volume successfully. Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-638bbd44-1a04-4939-b9d0-b4853bb90829 tempest-CinderUnicodeTest-1266181149 None] Created reservations ['cca3a72b-2a94-4ffe-8e67-9a8627a9f318', 'c29cca4f-f77e-458b-85bc-184547ab38be', '13bd9448-c2b7-46c3-83c3-8986215acfa0', '4ea59262-8d09-4105-9de6-df35e348bc16'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-615e8a7d-a0f2-497f-9f52-60340269b066 tempest-CreateVolumesFromSourceVolumeTest-1203803241 None] Lock "cinder-fab77ad0-10b3-42ba-a198-fcfb46344039-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-638bbd44-1a04-4939-b9d0-b4853bb90829 tempest-CinderUnicodeTest-1266181149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-638bbd44-1a04-4939-b9d0-b4853bb90829 tempest-CinderUnicodeTest-1266181149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-638bbd44-1a04-4939-b9d0-b4853bb90829 tempest-CinderUnicodeTest-1266181149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-638bbd44-1a04-4939-b9d0-b4853bb90829 tempest-CinderUnicodeTest-1266181149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-638bbd44-1a04-4939-b9d0-b4853bb90829 tempest-CinderUnicodeTest-1266181149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-638bbd44-1a04-4939-b9d0-b4853bb90829 tempest-CinderUnicodeTest-1266181149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:38 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:36:38 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f01d4134-c186-47e2-819c-bb7d79416590 tempest-SnapshotsActionsTest-975319395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:39 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-638bbd44-1a04-4939-b9d0-b4853bb90829 tempest-CinderUnicodeTest-1266181149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.334s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:39 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-638bbd44-1a04-4939-b9d0-b4853bb90829 tempest-CinderUnicodeTest-1266181149 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:36:39 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-638bbd44-1a04-4939-b9d0-b4853bb90829 tempest-CinderUnicodeTest-1266181149 None] Deleted volume successfully. Nov 06 14:36:39 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-cbf17990-cd03-4363-bab1-1a8591447d99 req-27baece1-cb06-4652-9223-a066abe5ae89 tempest-VolumesSnapshotsTestJSON-968795300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e.c1216242-2f6f-43d0-a3cd-6180cf1ba3fb 1G" returned: 0 in 0.545s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-cbf17990-cd03-4363-bab1-1a8591447d99 req-27baece1-cb06-4652-9223-a066abe5ae89 tempest-VolumesSnapshotsTestJSON-968795300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c84776de-d810-48fa-9491-56817a9b202e -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e.c1216242-2f6f-43d0-a3cd-6180cf1ba3fb {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:39 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-638bbd44-1a04-4939-b9d0-b4853bb90829 tempest-CinderUnicodeTest-1266181149 None] Lock "cinder-e467e467-2e99-4d27-9b3e-af4882a2e159-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:39 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c84776de-d810-48fa-9491-56817a9b202e -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e.c1216242-2f6f-43d0-a3cd-6180cf1ba3fb Nov 06 14:36:39 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:39 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-cbf17990-cd03-4363-bab1-1a8591447d99 req-27baece1-cb06-4652-9223-a066abe5ae89 tempest-VolumesSnapshotsTestJSON-968795300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c84776de-d810-48fa-9491-56817a9b202e -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e.c1216242-2f6f-43d0-a3cd-6180cf1ba3fb" returned: 0 in 0.325s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:39 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [req-cbf17990-cd03-4363-bab1-1a8591447d99 req-27baece1-cb06-4652-9223-a066abe5ae89 tempest-VolumesSnapshotsTestJSON-968795300 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e.c1216242-2f6f-43d0-a3cd-6180cf1ba3fb is being set with open permissions: ugo+rw Nov 06 14:36:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-cbf17990-cd03-4363-bab1-1a8591447d99 req-27baece1-cb06-4652-9223-a066abe5ae89 tempest-VolumesSnapshotsTestJSON-968795300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e.c1216242-2f6f-43d0-a3cd-6180cf1ba3fb {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:39 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e.c1216242-2f6f-43d0-a3cd-6180cf1ba3fb Nov 06 14:36:39 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:39 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-cbf17990-cd03-4363-bab1-1a8591447d99 req-27baece1-cb06-4652-9223-a066abe5ae89 tempest-VolumesSnapshotsTestJSON-968795300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e.c1216242-2f6f-43d0-a3cd-6180cf1ba3fb" returned: 0 in 0.286s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-cbf17990-cd03-4363-bab1-1a8591447d99 req-27baece1-cb06-4652-9223-a066abe5ae89 tempest-VolumesSnapshotsTestJSON-968795300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:39 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e.info Nov 06 14:36:39 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:40 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-cbf17990-cd03-4363-bab1-1a8591447d99 req-27baece1-cb06-4652-9223-a066abe5ae89 tempest-VolumesSnapshotsTestJSON-968795300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e.info" returned: 0 in 0.323s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:40 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [req-cbf17990-cd03-4363-bab1-1a8591447d99 req-27baece1-cb06-4652-9223-a066abe5ae89 tempest-VolumesSnapshotsTestJSON-968795300 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e.info is being set with open permissions: ugo+rw Nov 06 14:36:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-cbf17990-cd03-4363-bab1-1a8591447d99 req-27baece1-cb06-4652-9223-a066abe5ae89 tempest-VolumesSnapshotsTestJSON-968795300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:40 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e.info Nov 06 14:36:40 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:40 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-cbf17990-cd03-4363-bab1-1a8591447d99 req-27baece1-cb06-4652-9223-a066abe5ae89 tempest-VolumesSnapshotsTestJSON-968795300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e.info" returned: 0 in 0.261s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-cbf17990-cd03-4363-bab1-1a8591447d99 req-27baece1-cb06-4652-9223-a066abe5ae89 tempest-VolumesSnapshotsTestJSON-968795300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.320s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f01d4134-c186-47e2-819c-bb7d79416590 tempest-SnapshotsActionsTest-975319395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.357s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:40 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-f01d4134-c186-47e2-819c-bb7d79416590 tempest-SnapshotsActionsTest-975319395 None] Creating offline snapshot cab90193-9cf4-4ddb-bbef-301b10ad5a16 of volume 982ec8aa-fbfc-4c99-b131-d0e27779b154 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:36:40 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-cbf17990-cd03-4363-bab1-1a8591447d99 req-27baece1-cb06-4652-9223-a066abe5ae89 tempest-VolumesSnapshotsTestJSON-968795300 None] Create snapshot completed successfully Nov 06 14:36:40 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e8cb6e-7cad-4594-b0e0-2916bfca1e0a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f01d4134-c186-47e2-819c-bb7d79416590 tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:40 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee Nov 06 14:36:40 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:40 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f01d4134-c186-47e2-819c-bb7d79416590 tempest-SnapshotsActionsTest-975319395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee" returned: 0 in 0.419s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:40 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-f01d4134-c186-47e2-819c-bb7d79416590 tempest-SnapshotsActionsTest-975319395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-982ec8aa-fbfc-4c99-b131-d0e27779b154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:36:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f01d4134-c186-47e2-819c-bb7d79416590 tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.cab90193-9cf4-4ddb-bbef-301b10ad5a16 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:41 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.cab90193-9cf4-4ddb-bbef-301b10ad5a16 1G Nov 06 14:36:41 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:41 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f01d4134-c186-47e2-819c-bb7d79416590 tempest-SnapshotsActionsTest-975319395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.cab90193-9cf4-4ddb-bbef-301b10ad5a16 1G" returned: 0 in 0.538s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f01d4134-c186-47e2-819c-bb7d79416590 tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.cab90193-9cf4-4ddb-bbef-301b10ad5a16 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:41 devstack sudo[99467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.cab90193-9cf4-4ddb-bbef-301b10ad5a16 Nov 06 14:36:41 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:41 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-dfc0d6ad-be77-44a6-bc0a-e0610dbfa964 req-990aeb88-7f04-4656-b544-3bd2510cdbe5 tempest-VolumesSnapshotsTestJSON-968795300 None] Acquiring lock "cinder-c1216242-2f6f-43d0-a3cd-6180cf1ba3fb-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:41 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-dfc0d6ad-be77-44a6-bc0a-e0610dbfa964 req-990aeb88-7f04-4656-b544-3bd2510cdbe5 tempest-VolumesSnapshotsTestJSON-968795300 None] Lock "cinder-c1216242-2f6f-43d0-a3cd-6180cf1ba3fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:41 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-dfc0d6ad-be77-44a6-bc0a-e0610dbfa964 req-990aeb88-7f04-4656-b544-3bd2510cdbe5 tempest-VolumesSnapshotsTestJSON-968795300 None] Acquiring lock "cinder-quobyte-c84776de-d810-48fa-9491-56817a9b202e" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:41 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-dfc0d6ad-be77-44a6-bc0a-e0610dbfa964 req-990aeb88-7f04-4656-b544-3bd2510cdbe5 tempest-VolumesSnapshotsTestJSON-968795300 None] Lock "cinder-quobyte-c84776de-d810-48fa-9491-56817a9b202e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:41 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-dfc0d6ad-be77-44a6-bc0a-e0610dbfa964 req-990aeb88-7f04-4656-b544-3bd2510cdbe5 tempest-VolumesSnapshotsTestJSON-968795300 None] Acquiring lock "cinder-quobyte-c1216242-2f6f-43d0-a3cd-6180cf1ba3fb" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:41 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-dfc0d6ad-be77-44a6-bc0a-e0610dbfa964 req-990aeb88-7f04-4656-b544-3bd2510cdbe5 tempest-VolumesSnapshotsTestJSON-968795300 None] Lock "cinder-quobyte-c1216242-2f6f-43d0-a3cd-6180cf1ba3fb" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:41 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [req-dfc0d6ad-be77-44a6-bc0a-e0610dbfa964 req-990aeb88-7f04-4656-b544-3bd2510cdbe5 tempest-VolumesSnapshotsTestJSON-968795300 None] Deleting offline snapshot c1216242-2f6f-43d0-a3cd-6180cf1ba3fb of volume c84776de-d810-48fa-9491-56817a9b202e {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:36:41 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [req-dfc0d6ad-be77-44a6-bc0a-e0610dbfa964 req-990aeb88-7f04-4656-b544-3bd2510cdbe5 tempest-VolumesSnapshotsTestJSON-968795300 None] snapshot_file for this snap is: volume-c84776de-d810-48fa-9491-56817a9b202e.c1216242-2f6f-43d0-a3cd-6180cf1ba3fb {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:36:41 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5693a8-6def-4f01-831a-9bdd9bb903b3]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-dfc0d6ad-be77-44a6-bc0a-e0610dbfa964 req-990aeb88-7f04-4656-b544-3bd2510cdbe5 tempest-VolumesSnapshotsTestJSON-968795300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e.c1216242-2f6f-43d0-a3cd-6180cf1ba3fb {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:41 devstack sudo[99469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e.c1216242-2f6f-43d0-a3cd-6180cf1ba3fb Nov 06 14:36:41 devstack sudo[99469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:41 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f01d4134-c186-47e2-819c-bb7d79416590 tempest-SnapshotsActionsTest-975319395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.cab90193-9cf4-4ddb-bbef-301b10ad5a16" returned: 0 in 0.406s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:41 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-f01d4134-c186-47e2-819c-bb7d79416590 tempest-SnapshotsActionsTest-975319395 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.cab90193-9cf4-4ddb-bbef-301b10ad5a16 is being set with open permissions: ugo+rw Nov 06 14:36:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f01d4134-c186-47e2-819c-bb7d79416590 tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.cab90193-9cf4-4ddb-bbef-301b10ad5a16 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:41 devstack sudo[99474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.cab90193-9cf4-4ddb-bbef-301b10ad5a16 Nov 06 14:36:41 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:42 devstack sudo[99469]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-dfc0d6ad-be77-44a6-bc0a-e0610dbfa964 req-990aeb88-7f04-4656-b544-3bd2510cdbe5 tempest-VolumesSnapshotsTestJSON-968795300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e.c1216242-2f6f-43d0-a3cd-6180cf1ba3fb" returned: 0 in 0.453s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:42 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [req-dfc0d6ad-be77-44a6-bc0a-e0610dbfa964 req-990aeb88-7f04-4656-b544-3bd2510cdbe5 tempest-VolumesSnapshotsTestJSON-968795300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c84776de-d810-48fa-9491-56817a9b202e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:36:42 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f01d4134-c186-47e2-819c-bb7d79416590 tempest-SnapshotsActionsTest-975319395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.cab90193-9cf4-4ddb-bbef-301b10ad5a16" returned: 0 in 0.338s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f01d4134-c186-47e2-819c-bb7d79416590 tempest-SnapshotsActionsTest-975319395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.841s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:42 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16aba9e-22d9-4d4e-a2af-2c65b025c2bc]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-dfc0d6ad-be77-44a6-bc0a-e0610dbfa964 req-990aeb88-7f04-4656-b544-3bd2510cdbe5 tempest-VolumesSnapshotsTestJSON-968795300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:42 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-f01d4134-c186-47e2-819c-bb7d79416590 tempest-SnapshotsActionsTest-975319395 None] Create snapshot completed successfully Nov 06 14:36:42 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e Nov 06 14:36:42 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:42 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-dfc0d6ad-be77-44a6-bc0a-e0610dbfa964 req-990aeb88-7f04-4656-b544-3bd2510cdbe5 tempest-VolumesSnapshotsTestJSON-968795300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e" returned: 0 in 0.442s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-dfc0d6ad-be77-44a6-bc0a-e0610dbfa964 req-990aeb88-7f04-4656-b544-3bd2510cdbe5 tempest-VolumesSnapshotsTestJSON-968795300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e.c1216242-2f6f-43d0-a3cd-6180cf1ba3fb {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:42 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e.c1216242-2f6f-43d0-a3cd-6180cf1ba3fb Nov 06 14:36:42 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:42 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:36:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Flow 'volume_create_manager' (b815c6d8-b481-4bd5-8275-9b1653244252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88467c57-6ef7-499f-8f4c-8cf806e7c71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88467c57-6ef7-499f-8f4c-8cf806e7c71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-856325026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83edc27a-654b-4815-86b0-074a4aea2977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae34b1dc7b54cfb933c75679403d010',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:43Z,use_quota=True,user_id='03971387f92f423495bad4e21d163124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af018e98-0332-4289-8018-a0c2debd83f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af018e98-0332-4289-8018-a0c2debd83f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eddf641-8dcf-4716-8d07-25088c405249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eddf641-8dcf-4716-8d07-25088c405249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83edc27a-654b-4815-86b0-074a4aea2977', 'volume_name': 'volume-83edc27a-654b-4815-86b0-074a4aea2977', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b053174f-2948-434f-8b09-44eaed430e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b053174f-2948-434f-8b09-44eaed430e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03b0420-3be9-4fe7-a397-a18ddd8a4aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:42 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Volume 83edc27a-654b-4815-86b0-074a4aea2977: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83edc27a-654b-4815-86b0-074a4aea2977', 'volume_size': 1} Nov 06 14:36:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-856325026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83edc27a-654b-4815-86b0-074a4aea2977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae34b1dc7b54cfb933c75679403d010',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:43Z,use_quota=True,user_id='03971387f92f423495bad4e21d163124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Creating volume 83edc27a-654b-4815-86b0-074a4aea2977 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:36:43 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:43 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977 1073741824 Nov 06 14:36:43 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:UPDATE=268,cinder:SELECT=229,cinder:INSERT=73,cinder:DELETE=24 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:36:43 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Flow 'volume_create_manager' (16dd728b-6e88-4485-a634-f5069c110189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7245423-e362-4d32-9bd0-7fa4b1da7fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-dfc0d6ad-be77-44a6-bc0a-e0610dbfa964 req-990aeb88-7f04-4656-b544-3bd2510cdbe5 tempest-VolumesSnapshotsTestJSON-968795300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e.c1216242-2f6f-43d0-a3cd-6180cf1ba3fb" returned: 0 in 0.437s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-dfc0d6ad-be77-44a6-bc0a-e0610dbfa964 req-990aeb88-7f04-4656-b544-3bd2510cdbe5 tempest-VolumesSnapshotsTestJSON-968795300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e.c1216242-2f6f-43d0-a3cd-6180cf1ba3fb {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7245423-e362-4d32-9bd0-7fa4b1da7fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-213037125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7467d3-06f5-4f04-b80d-059d0ac7fc59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14f67ed5cc764cbb855d8e567e1777bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:43Z,use_quota=True,user_id='e8fc1cabcfb547768f8bb34da8bbf90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8207fbff-8ba9-4d6e-a064-9ae722b4da8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:43 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e.c1216242-2f6f-43d0-a3cd-6180cf1ba3fb Nov 06 14:36:43 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8207fbff-8ba9-4d6e-a064-9ae722b4da8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cc4835c-25eb-4bd9-a92b-12ad474d73bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cc4835c-25eb-4bd9-a92b-12ad474d73bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d7467d3-06f5-4f04-b80d-059d0ac7fc59', 'volume_name': 'volume-6d7467d3-06f5-4f04-b80d-059d0ac7fc59', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (677f1ee9-a924-4dd0-ac1b-d674adab3933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (677f1ee9-a924-4dd0-ac1b-d674adab3933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a686b1-d8e1-4340-a2cb-ce9682629105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:43 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Volume 6d7467d3-06f5-4f04-b80d-059d0ac7fc59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d7467d3-06f5-4f04-b80d-059d0ac7fc59', 'volume_size': 1} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6f77d8b0-1975-4af8-831d-1c547056a8a1 tempest-SnapshotsActionsTest-893473510 None] Acquiring lock "cinder-cab90193-9cf4-4ddb-bbef-301b10ad5a16-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6f77d8b0-1975-4af8-831d-1c547056a8a1 tempest-SnapshotsActionsTest-893473510 None] Lock "cinder-cab90193-9cf4-4ddb-bbef-301b10ad5a16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6f77d8b0-1975-4af8-831d-1c547056a8a1 tempest-SnapshotsActionsTest-893473510 None] Acquiring lock "cinder-quobyte-982ec8aa-fbfc-4c99-b131-d0e27779b154" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:43 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-dfc0d6ad-be77-44a6-bc0a-e0610dbfa964 req-990aeb88-7f04-4656-b544-3bd2510cdbe5 tempest-VolumesSnapshotsTestJSON-968795300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e.c1216242-2f6f-43d0-a3cd-6180cf1ba3fb" returned: 0 in 0.294s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6f77d8b0-1975-4af8-831d-1c547056a8a1 tempest-SnapshotsActionsTest-893473510 None] Lock "cinder-quobyte-982ec8aa-fbfc-4c99-b131-d0e27779b154" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6f77d8b0-1975-4af8-831d-1c547056a8a1 tempest-SnapshotsActionsTest-893473510 None] Acquiring lock "cinder-quobyte-cab90193-9cf4-4ddb-bbef-301b10ad5a16" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6f77d8b0-1975-4af8-831d-1c547056a8a1 tempest-SnapshotsActionsTest-893473510 None] Lock "cinder-quobyte-cab90193-9cf4-4ddb-bbef-301b10ad5a16" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-6f77d8b0-1975-4af8-831d-1c547056a8a1 tempest-SnapshotsActionsTest-893473510 None] Deleting offline snapshot cab90193-9cf4-4ddb-bbef-301b10ad5a16 of volume 982ec8aa-fbfc-4c99-b131-d0e27779b154 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:36:43 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-6f77d8b0-1975-4af8-831d-1c547056a8a1 tempest-SnapshotsActionsTest-893473510 None] snapshot_file for this snap is: volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.cab90193-9cf4-4ddb-bbef-301b10ad5a16 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-dfc0d6ad-be77-44a6-bc0a-e0610dbfa964 req-990aeb88-7f04-4656-b544-3bd2510cdbe5 tempest-VolumesSnapshotsTestJSON-968795300 None] Lock "cinder-quobyte-c1216242-2f6f-43d0-a3cd-6180cf1ba3fb" released by "_delete_snapshot" :: held 1.842s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977 1073741824" returned: 0 in 0.557s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-dfc0d6ad-be77-44a6-bc0a-e0610dbfa964 req-990aeb88-7f04-4656-b544-3bd2510cdbe5 tempest-VolumesSnapshotsTestJSON-968795300 None] Lock "cinder-quobyte-c84776de-d810-48fa-9491-56817a9b202e" released by "delete_snapshot" :: held 1.873s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[1233ce76-b8c2-4269-8bb6-d015c02e3e94]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6f77d8b0-1975-4af8-831d-1c547056a8a1 tempest-SnapshotsActionsTest-893473510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.cab90193-9cf4-4ddb-bbef-301b10ad5a16 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:43 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977 Nov 06 14:36:43 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.quota [req-dfc0d6ad-be77-44a6-bc0a-e0610dbfa964 req-990aeb88-7f04-4656-b544-3bd2510cdbe5 tempest-VolumesSnapshotsTestJSON-968795300 None] Created reservations ['c397412f-e079-4338-9351-66acd05bcd53', '7709f237-19ac-4cea-af72-b910dc6b4210', 'bcbb642c-7fc0-475c-9496-11b161f08890', '91ba2585-7caf-411f-88f3-9824bdd5e3ee'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:43 devstack sudo[99498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.cab90193-9cf4-4ddb-bbef-301b10ad5a16 Nov 06 14:36:43 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:43 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-dfc0d6ad-be77-44a6-bc0a-e0610dbfa964 req-990aeb88-7f04-4656-b544-3bd2510cdbe5 tempest-VolumesSnapshotsTestJSON-968795300 None] Delete snapshot completed successfully. Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-dfc0d6ad-be77-44a6-bc0a-e0610dbfa964 req-990aeb88-7f04-4656-b544-3bd2510cdbe5 tempest-VolumesSnapshotsTestJSON-968795300 None] Lock "cinder-c1216242-2f6f-43d0-a3cd-6180cf1ba3fb-delete_snapshot" released by "delete_snapshot" :: held 2.064s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:43 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977" returned: 0 in 0.289s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.665s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-213037125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7467d3-06f5-4f04-b80d-059d0ac7fc59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14f67ed5cc764cbb855d8e567e1777bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:43Z,use_quota=True,user_id='e8fc1cabcfb547768f8bb34da8bbf90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Creating volume 6d7467d3-06f5-4f04-b80d-059d0ac7fc59 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:36:43 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6d7467d3-06f5-4f04-b80d-059d0ac7fc59 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03b0420-3be9-4fe7-a397-a18ddd8a4aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83edc27a-654b-4815-86b0-074a4aea2977', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:43 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6d7467d3-06f5-4f04-b80d-059d0ac7fc59 1073741824 Nov 06 14:36:43 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40486f6a-7f6b-444b-83f5-9779da8bfd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-04bb6fc1-06c5-4c18-aed4-92a8f03d8eb1 req-ec652a48-9d76-4482-a792-7b5397a2f850 tempest-VolumesSnapshotsTestJSON-968795300 None] Acquiring lock "cinder-c84776de-d810-48fa-9491-56817a9b202e-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:44 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Volume volume-83edc27a-654b-4815-86b0-074a4aea2977 (83edc27a-654b-4815-86b0-074a4aea2977): created successfully Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40486f6a-7f6b-444b-83f5-9779da8bfd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Flow 'volume_create_manager' (b815c6d8-b481-4bd5-8275-9b1653244252) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:44 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-04bb6fc1-06c5-4c18-aed4-92a8f03d8eb1 req-ec652a48-9d76-4482-a792-7b5397a2f850 tempest-VolumesSnapshotsTestJSON-968795300 None] Lock "cinder-c84776de-d810-48fa-9491-56817a9b202e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6f77d8b0-1975-4af8-831d-1c547056a8a1 tempest-SnapshotsActionsTest-893473510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.cab90193-9cf4-4ddb-bbef-301b10ad5a16" returned: 0 in 0.445s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-6f77d8b0-1975-4af8-831d-1c547056a8a1 tempest-SnapshotsActionsTest-893473510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-982ec8aa-fbfc-4c99-b131-d0e27779b154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:36:44 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-2a437921-c515-42cc-a816-b29b6e50887c tempest-VolumeDependencyTests-783596712 None] Created volume successfully. Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc2384a-a578-4a2f-a8d7-5ad9cfdcc84b]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6f77d8b0-1975-4af8-831d-1c547056a8a1 tempest-SnapshotsActionsTest-893473510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-04bb6fc1-06c5-4c18-aed4-92a8f03d8eb1 req-ec652a48-9d76-4482-a792-7b5397a2f850 tempest-VolumesSnapshotsTestJSON-968795300 None] Acquiring lock "cinder-quobyte-c84776de-d810-48fa-9491-56817a9b202e" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-04bb6fc1-06c5-4c18-aed4-92a8f03d8eb1 req-ec652a48-9d76-4482-a792-7b5397a2f850 tempest-VolumesSnapshotsTestJSON-968795300 None] Lock "cinder-quobyte-c84776de-d810-48fa-9491-56817a9b202e" acquired by "delete_volume" :: waited 0.022s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[5839777e-f93c-4595-8932-056b79403f5d]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-04bb6fc1-06c5-4c18-aed4-92a8f03d8eb1 req-ec652a48-9d76-4482-a792-7b5397a2f850 tempest-VolumesSnapshotsTestJSON-968795300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:44 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee Nov 06 14:36:44 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:44 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e Nov 06 14:36:44 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:44 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6d7467d3-06f5-4f04-b80d-059d0ac7fc59 1073741824" returned: 0 in 0.488s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6d7467d3-06f5-4f04-b80d-059d0ac7fc59 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:44 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6d7467d3-06f5-4f04-b80d-059d0ac7fc59 Nov 06 14:36:44 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:44 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6f77d8b0-1975-4af8-831d-1c547056a8a1 tempest-SnapshotsActionsTest-893473510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee" returned: 0 in 0.424s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-6f77d8b0-1975-4af8-831d-1c547056a8a1 tempest-SnapshotsActionsTest-893473510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-982ec8aa-fbfc-4c99-b131-d0e27779b154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6f77d8b0-1975-4af8-831d-1c547056a8a1 tempest-SnapshotsActionsTest-893473510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.cab90193-9cf4-4ddb-bbef-301b10ad5a16 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:44 devstack sudo[99523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.cab90193-9cf4-4ddb-bbef-301b10ad5a16 Nov 06 14:36:44 devstack sudo[99523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:44 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-04bb6fc1-06c5-4c18-aed4-92a8f03d8eb1 req-ec652a48-9d76-4482-a792-7b5397a2f850 tempest-VolumesSnapshotsTestJSON-968795300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e" returned: 0 in 0.385s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-04bb6fc1-06c5-4c18-aed4-92a8f03d8eb1 req-ec652a48-9d76-4482-a792-7b5397a2f850 tempest-VolumesSnapshotsTestJSON-968795300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:44 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e Nov 06 14:36:44 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:44 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6d7467d3-06f5-4f04-b80d-059d0ac7fc59" returned: 0 in 0.261s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a686b1-d8e1-4340-a2cb-ce9682629105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d7467d3-06f5-4f04-b80d-059d0ac7fc59', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed749aff-c414-42a2-823b-c6832108ef52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:44 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Volume volume-6d7467d3-06f5-4f04-b80d-059d0ac7fc59 (6d7467d3-06f5-4f04-b80d-059d0ac7fc59): created successfully Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed749aff-c414-42a2-823b-c6832108ef52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Flow 'volume_create_manager' (16dd728b-6e88-4485-a634-f5069c110189) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:44 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-0b76e8fb-bdbe-4526-bfcd-4d8999783c01 tempest-ProjectReaderTests-549603794 None] Created volume successfully. Nov 06 14:36:44 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-04bb6fc1-06c5-4c18-aed4-92a8f03d8eb1 req-ec652a48-9d76-4482-a792-7b5397a2f850 tempest-VolumesSnapshotsTestJSON-968795300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c84776de-d810-48fa-9491-56817a9b202e" returned: 0 in 0.270s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-04bb6fc1-06c5-4c18-aed4-92a8f03d8eb1 req-ec652a48-9d76-4482-a792-7b5397a2f850 tempest-VolumesSnapshotsTestJSON-968795300 None] Lock "cinder-quobyte-c84776de-d810-48fa-9491-56817a9b202e" released by "delete_volume" :: held 0.731s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG cinder.quota [req-04bb6fc1-06c5-4c18-aed4-92a8f03d8eb1 req-ec652a48-9d76-4482-a792-7b5397a2f850 tempest-VolumesSnapshotsTestJSON-968795300 None] Created reservations ['0497869a-6925-4f88-bfab-ebe01c9e461e', '98e28502-5a8a-4437-8de2-159e93f606f2', '67a881e0-7f67-4973-ae9f-087cdb5300e6', 'a0d4426d-1e58-452a-9ab3-81ee5aaf171e'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:44 devstack sudo[99523]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6f77d8b0-1975-4af8-831d-1c547056a8a1 tempest-SnapshotsActionsTest-893473510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.cab90193-9cf4-4ddb-bbef-301b10ad5a16" returned: 0 in 0.440s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6f77d8b0-1975-4af8-831d-1c547056a8a1 tempest-SnapshotsActionsTest-893473510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.cab90193-9cf4-4ddb-bbef-301b10ad5a16 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:44 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.cab90193-9cf4-4ddb-bbef-301b10ad5a16 Nov 06 14:36:44 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-04bb6fc1-06c5-4c18-aed4-92a8f03d8eb1 req-ec652a48-9d76-4482-a792-7b5397a2f850 tempest-VolumesSnapshotsTestJSON-968795300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-04bb6fc1-06c5-4c18-aed4-92a8f03d8eb1 req-ec652a48-9d76-4482-a792-7b5397a2f850 tempest-VolumesSnapshotsTestJSON-968795300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [req-04bb6fc1-06c5-4c18-aed4-92a8f03d8eb1 req-ec652a48-9d76-4482-a792-7b5397a2f850 tempest-VolumesSnapshotsTestJSON-968795300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [req-04bb6fc1-06c5-4c18-aed4-92a8f03d8eb1 req-ec652a48-9d76-4482-a792-7b5397a2f850 tempest-VolumesSnapshotsTestJSON-968795300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-04bb6fc1-06c5-4c18-aed4-92a8f03d8eb1 req-ec652a48-9d76-4482-a792-7b5397a2f850 tempest-VolumesSnapshotsTestJSON-968795300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-04bb6fc1-06c5-4c18-aed4-92a8f03d8eb1 req-ec652a48-9d76-4482-a792-7b5397a2f850 tempest-VolumesSnapshotsTestJSON-968795300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:45 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:36:45 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-25073ef6-5d74-44e4-a2e8-a746e5deb4ba tempest-VolumeDependencyTests-783596712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-25073ef6-5d74-44e4-a2e8-a746e5deb4ba tempest-VolumeDependencyTests-783596712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:45 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-25073ef6-5d74-44e4-a2e8-a746e5deb4ba tempest-VolumeDependencyTests-783596712 None] Creating offline snapshot c4e304bb-0ff7-4cc4-972c-70389efc2a6d of volume 83edc27a-654b-4815-86b0-074a4aea2977 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:36:45 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[2596c823-a018-4617-90bb-659c35747c91]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25073ef6-5d74-44e4-a2e8-a746e5deb4ba tempest-VolumeDependencyTests-783596712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:45 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6f77d8b0-1975-4af8-831d-1c547056a8a1 tempest-SnapshotsActionsTest-893473510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.cab90193-9cf4-4ddb-bbef-301b10ad5a16" returned: 0 in 0.388s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:45 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-04bb6fc1-06c5-4c18-aed4-92a8f03d8eb1 req-ec652a48-9d76-4482-a792-7b5397a2f850 tempest-VolumesSnapshotsTestJSON-968795300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.364s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:45 devstack cinder-volume[86854]: DEBUG cinder.manager [req-04bb6fc1-06c5-4c18-aed4-92a8f03d8eb1 req-ec652a48-9d76-4482-a792-7b5397a2f850 tempest-VolumesSnapshotsTestJSON-968795300 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:36:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6f77d8b0-1975-4af8-831d-1c547056a8a1 tempest-SnapshotsActionsTest-893473510 None] Lock "cinder-quobyte-cab90193-9cf4-4ddb-bbef-301b10ad5a16" released by "_delete_snapshot" :: held 1.834s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:45 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-04bb6fc1-06c5-4c18-aed4-92a8f03d8eb1 req-ec652a48-9d76-4482-a792-7b5397a2f850 tempest-VolumesSnapshotsTestJSON-968795300 None] Deleted volume successfully. Nov 06 14:36:45 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977 Nov 06 14:36:45 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6f77d8b0-1975-4af8-831d-1c547056a8a1 tempest-SnapshotsActionsTest-893473510 None] Lock "cinder-quobyte-982ec8aa-fbfc-4c99-b131-d0e27779b154" released by "delete_snapshot" :: held 1.901s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-04bb6fc1-06c5-4c18-aed4-92a8f03d8eb1 req-ec652a48-9d76-4482-a792-7b5397a2f850 tempest-VolumesSnapshotsTestJSON-968795300 None] Lock "cinder-c84776de-d810-48fa-9491-56817a9b202e-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:45 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-6f77d8b0-1975-4af8-831d-1c547056a8a1 tempest-SnapshotsActionsTest-893473510 None] Created reservations ['c73c7044-8290-463a-b190-3b892364ea17', 'a664d29b-d804-4546-b14c-41dc1644d666', '59eeaa24-e63a-4331-86a6-1204279da4a9', '9884e686-a1d5-4aaf-ba9f-a11c3cfa66e3'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:45 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=238,cinder:INSERT=71,cinder:UPDATE=315,cinder:DELETE=19 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:36:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-942e67c5-5e7c-46ee-870a-32d9d1bc8369 tempest-ProjectReaderTests-549603794 None] Acquiring lock "cinder-6d7467d3-06f5-4f04-b80d-059d0ac7fc59-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-942e67c5-5e7c-46ee-870a-32d9d1bc8369 tempest-ProjectReaderTests-549603794 None] Lock "cinder-6d7467d3-06f5-4f04-b80d-059d0ac7fc59-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:45 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-6f77d8b0-1975-4af8-831d-1c547056a8a1 tempest-SnapshotsActionsTest-893473510 None] Delete snapshot completed successfully. Nov 06 14:36:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6f77d8b0-1975-4af8-831d-1c547056a8a1 tempest-SnapshotsActionsTest-893473510 None] Lock "cinder-cab90193-9cf4-4ddb-bbef-301b10ad5a16-delete_snapshot" released by "delete_snapshot" :: held 2.164s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-942e67c5-5e7c-46ee-870a-32d9d1bc8369 tempest-ProjectReaderTests-549603794 None] Acquiring lock "cinder-quobyte-6d7467d3-06f5-4f04-b80d-059d0ac7fc59" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-942e67c5-5e7c-46ee-870a-32d9d1bc8369 tempest-ProjectReaderTests-549603794 None] Lock "cinder-quobyte-6d7467d3-06f5-4f04-b80d-059d0ac7fc59" acquired by "delete_volume" :: waited 0.024s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:45 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[975ff7ec-1486-4286-be68-a6b585eaaac0]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-942e67c5-5e7c-46ee-870a-32d9d1bc8369 tempest-ProjectReaderTests-549603794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6d7467d3-06f5-4f04-b80d-059d0ac7fc59 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:45 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25073ef6-5d74-44e4-a2e8-a746e5deb4ba tempest-VolumeDependencyTests-783596712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977" returned: 0 in 0.534s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25073ef6-5d74-44e4-a2e8-a746e5deb4ba tempest-VolumeDependencyTests-783596712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.c4e304bb-0ff7-4cc4-972c-70389efc2a6d 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:45 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.c4e304bb-0ff7-4cc4-972c-70389efc2a6d 1G Nov 06 14:36:45 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:45 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6d7467d3-06f5-4f04-b80d-059d0ac7fc59 Nov 06 14:36:45 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-37e3de94-b4b7-40ae-8cc1-1c588ec80eef tempest-SnapshotsActionsTest-975319395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:46 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-942e67c5-5e7c-46ee-870a-32d9d1bc8369 tempest-ProjectReaderTests-549603794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6d7467d3-06f5-4f04-b80d-059d0ac7fc59" returned: 0 in 0.504s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-942e67c5-5e7c-46ee-870a-32d9d1bc8369 tempest-ProjectReaderTests-549603794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6d7467d3-06f5-4f04-b80d-059d0ac7fc59 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:46 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6d7467d3-06f5-4f04-b80d-059d0ac7fc59 Nov 06 14:36:46 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:46 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25073ef6-5d74-44e4-a2e8-a746e5deb4ba tempest-VolumeDependencyTests-783596712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.c4e304bb-0ff7-4cc4-972c-70389efc2a6d 1G" returned: 0 in 0.541s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25073ef6-5d74-44e4-a2e8-a746e5deb4ba tempest-VolumeDependencyTests-783596712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83edc27a-654b-4815-86b0-074a4aea2977 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.c4e304bb-0ff7-4cc4-972c-70389efc2a6d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:46 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83edc27a-654b-4815-86b0-074a4aea2977 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.c4e304bb-0ff7-4cc4-972c-70389efc2a6d Nov 06 14:36:46 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:46 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-942e67c5-5e7c-46ee-870a-32d9d1bc8369 tempest-ProjectReaderTests-549603794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6d7467d3-06f5-4f04-b80d-059d0ac7fc59" returned: 0 in 0.267s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:46 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-942e67c5-5e7c-46ee-870a-32d9d1bc8369 tempest-ProjectReaderTests-549603794 None] Lock "cinder-quobyte-6d7467d3-06f5-4f04-b80d-059d0ac7fc59" released by "delete_volume" :: held 0.827s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:46 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-942e67c5-5e7c-46ee-870a-32d9d1bc8369 tempest-ProjectReaderTests-549603794 None] Created reservations ['9428eece-3cb9-48e1-b761-c5252fc0da9b', '026f2687-8b6c-4de1-8352-f9d5c2408604', 'ba4a3e0d-855c-48da-98e0-916f2b134e84', 'f10eaf68-0f5f-446e-b75d-3faa19fef1ae'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-942e67c5-5e7c-46ee-870a-32d9d1bc8369 tempest-ProjectReaderTests-549603794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-942e67c5-5e7c-46ee-870a-32d9d1bc8369 tempest-ProjectReaderTests-549603794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:46 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-942e67c5-5e7c-46ee-870a-32d9d1bc8369 tempest-ProjectReaderTests-549603794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:46 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-942e67c5-5e7c-46ee-870a-32d9d1bc8369 tempest-ProjectReaderTests-549603794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-942e67c5-5e7c-46ee-870a-32d9d1bc8369 tempest-ProjectReaderTests-549603794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-942e67c5-5e7c-46ee-870a-32d9d1bc8369 tempest-ProjectReaderTests-549603794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:46 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25073ef6-5d74-44e4-a2e8-a746e5deb4ba tempest-VolumeDependencyTests-783596712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83edc27a-654b-4815-86b0-074a4aea2977 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.c4e304bb-0ff7-4cc4-972c-70389efc2a6d" returned: 0 in 0.346s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:46 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-25073ef6-5d74-44e4-a2e8-a746e5deb4ba tempest-VolumeDependencyTests-783596712 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.c4e304bb-0ff7-4cc4-972c-70389efc2a6d is being set with open permissions: ugo+rw Nov 06 14:36:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25073ef6-5d74-44e4-a2e8-a746e5deb4ba tempest-VolumeDependencyTests-783596712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.c4e304bb-0ff7-4cc4-972c-70389efc2a6d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:46 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:36:46 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:46 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.c4e304bb-0ff7-4cc4-972c-70389efc2a6d Nov 06 14:36:46 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:46 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-942e67c5-5e7c-46ee-870a-32d9d1bc8369 tempest-ProjectReaderTests-549603794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.293s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:46 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-942e67c5-5e7c-46ee-870a-32d9d1bc8369 tempest-ProjectReaderTests-549603794 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:36:46 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-942e67c5-5e7c-46ee-870a-32d9d1bc8369 tempest-ProjectReaderTests-549603794 None] Deleted volume successfully. Nov 06 14:36:46 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25073ef6-5d74-44e4-a2e8-a746e5deb4ba tempest-VolumeDependencyTests-783596712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.c4e304bb-0ff7-4cc4-972c-70389efc2a6d" returned: 0 in 0.297s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:46 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-942e67c5-5e7c-46ee-870a-32d9d1bc8369 tempest-ProjectReaderTests-549603794 None] Lock "cinder-6d7467d3-06f5-4f04-b80d-059d0ac7fc59-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25073ef6-5d74-44e4-a2e8-a746e5deb4ba tempest-VolumeDependencyTests-783596712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:47 devstack sudo[99569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.info Nov 06 14:36:47 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:47 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25073ef6-5d74-44e4-a2e8-a746e5deb4ba tempest-VolumeDependencyTests-783596712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.info" returned: 0 in 0.348s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:47 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-25073ef6-5d74-44e4-a2e8-a746e5deb4ba tempest-VolumeDependencyTests-783596712 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.info is being set with open permissions: ugo+rw Nov 06 14:36:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25073ef6-5d74-44e4-a2e8-a746e5deb4ba tempest-VolumeDependencyTests-783596712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:47 devstack sudo[99572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.info Nov 06 14:36:47 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:47 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:36:47 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Flow 'volume_create_manager' (968fb371-94a7-432c-85eb-94abb179ccbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:47 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f70dbcb-b94c-47a8-9885-6e89083e7969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:47 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f70dbcb-b94c-47a8-9885-6e89083e7969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1118746148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d1d89b-a048-4d41-ab3b-fb881cd5dd63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14f67ed5cc764cbb855d8e567e1777bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:47Z,use_quota=True,user_id='e8fc1cabcfb547768f8bb34da8bbf90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:47 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa3b5d8-8f35-4203-8e6d-2e1a627ea8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:47 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa3b5d8-8f35-4203-8e6d-2e1a627ea8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:47 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8dfa624-0af9-46c3-b076-1c29a642a4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:47 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8dfa624-0af9-46c3-b076-1c29a642a4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36d1d89b-a048-4d41-ab3b-fb881cd5dd63', 'volume_name': 'volume-36d1d89b-a048-4d41-ab3b-fb881cd5dd63', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:47 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf00bc2-14d8-4030-a43e-8c1237e4356b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:47 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf00bc2-14d8-4030-a43e-8c1237e4356b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:47 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d44494e-bd0a-4b90-91d2-9962352e8e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:47 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Volume 36d1d89b-a048-4d41-ab3b-fb881cd5dd63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36d1d89b-a048-4d41-ab3b-fb881cd5dd63', 'volume_size': 1} Nov 06 14:36:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:47 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25073ef6-5d74-44e4-a2e8-a746e5deb4ba tempest-VolumeDependencyTests-783596712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.info" returned: 0 in 0.259s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-25073ef6-5d74-44e4-a2e8-a746e5deb4ba tempest-VolumeDependencyTests-783596712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.464s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-37e3de94-b4b7-40ae-8cc1-1c588ec80eef tempest-SnapshotsActionsTest-975319395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.553s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:47 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-37e3de94-b4b7-40ae-8cc1-1c588ec80eef tempest-SnapshotsActionsTest-975319395 None] Creating offline snapshot a185e499-7e8d-4486-a4a1-b2141bab1f9b of volume 982ec8aa-fbfc-4c99-b131-d0e27779b154 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:36:47 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-25073ef6-5d74-44e4-a2e8-a746e5deb4ba tempest-VolumeDependencyTests-783596712 None] Create snapshot completed successfully Nov 06 14:36:47 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec62211-006c-4e17-8a3f-48aef4cf383a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-37e3de94-b4b7-40ae-8cc1-1c588ec80eef tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:47 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee Nov 06 14:36:47 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:48 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-37e3de94-b4b7-40ae-8cc1-1c588ec80eef tempest-SnapshotsActionsTest-975319395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee" returned: 0 in 0.360s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:48 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-37e3de94-b4b7-40ae-8cc1-1c588ec80eef tempest-SnapshotsActionsTest-975319395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-982ec8aa-fbfc-4c99-b131-d0e27779b154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:36:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-37e3de94-b4b7-40ae-8cc1-1c588ec80eef tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.a185e499-7e8d-4486-a4a1-b2141bab1f9b 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:48 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.a185e499-7e8d-4486-a4a1-b2141bab1f9b 1G Nov 06 14:36:48 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:48 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-37e3de94-b4b7-40ae-8cc1-1c588ec80eef tempest-SnapshotsActionsTest-975319395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.a185e499-7e8d-4486-a4a1-b2141bab1f9b 1G" returned: 0 in 0.525s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-37e3de94-b4b7-40ae-8cc1-1c588ec80eef tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.a185e499-7e8d-4486-a4a1-b2141bab1f9b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:48 devstack sudo[99586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.a185e499-7e8d-4486-a4a1-b2141bab1f9b Nov 06 14:36:48 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:48 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-37e3de94-b4b7-40ae-8cc1-1c588ec80eef tempest-SnapshotsActionsTest-975319395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.a185e499-7e8d-4486-a4a1-b2141bab1f9b" returned: 0 in 0.333s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:48 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-37e3de94-b4b7-40ae-8cc1-1c588ec80eef tempest-SnapshotsActionsTest-975319395 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.a185e499-7e8d-4486-a4a1-b2141bab1f9b is being set with open permissions: ugo+rw Nov 06 14:36:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-37e3de94-b4b7-40ae-8cc1-1c588ec80eef tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.a185e499-7e8d-4486-a4a1-b2141bab1f9b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:48 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.a185e499-7e8d-4486-a4a1-b2141bab1f9b Nov 06 14:36:48 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:49 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:36:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Flow 'volume_create_manager' (3ba2260e-25cf-4b8b-9963-0b579f85e015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0c91ea-eec8-41e9-8d79-bba957157f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0c91ea-eec8-41e9-8d79-bba957157f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-11923964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a52e60fa-3173-49cd-940b-c0e67c1d35d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae34b1dc7b54cfb933c75679403d010',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c4e304bb-0ff7-4cc4-972c-70389efc2a6d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:49Z,use_quota=True,user_id='03971387f92f423495bad4e21d163124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22742e03-e59b-47e9-b2c2-ed737c6ef602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22742e03-e59b-47e9-b2c2-ed737c6ef602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4518dcb-838b-4d42-a3bb-bf3c1d7e4a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4518dcb-838b-4d42-a3bb-bf3c1d7e4a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a52e60fa-3173-49cd-940b-c0e67c1d35d4', 'volume_name': 'volume-a52e60fa-3173-49cd-940b-c0e67c1d35d4', 'volume_size': 1, 'snapshot_id': 'c4e304bb-0ff7-4cc4-972c-70389efc2a6d'}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39cd1698-5c96-4ec7-9dba-c4a999182649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39cd1698-5c96-4ec7-9dba-c4a999182649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0a39d31-3377-4c63-8517-77c16c8e0ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:49 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Volume a52e60fa-3173-49cd-940b-c0e67c1d35d4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a52e60fa-3173-49cd-940b-c0e67c1d35d4', 'volume_size': 1, 'snapshot_id': 'c4e304bb-0ff7-4cc4-972c-70389efc2a6d'} Nov 06 14:36:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:49 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-37e3de94-b4b7-40ae-8cc1-1c588ec80eef tempest-SnapshotsActionsTest-975319395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.a185e499-7e8d-4486-a4a1-b2141bab1f9b" returned: 0 in 0.278s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-37e3de94-b4b7-40ae-8cc1-1c588ec80eef tempest-SnapshotsActionsTest-975319395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.628s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.791s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:49 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1118746148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d1d89b-a048-4d41-ab3b-fb881cd5dd63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14f67ed5cc764cbb855d8e567e1777bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:36:47Z,use_quota=True,user_id='e8fc1cabcfb547768f8bb34da8bbf90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:36:49 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Creating volume 36d1d89b-a048-4d41-ab3b-fb881cd5dd63 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:36:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:49 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:49 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:49 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:36:49 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:36:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-36d1d89b-a048-4d41-ab3b-fb881cd5dd63 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:49 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-36d1d89b-a048-4d41-ab3b-fb881cd5dd63 1073741824 Nov 06 14:36:49 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:49 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-37e3de94-b4b7-40ae-8cc1-1c588ec80eef tempest-SnapshotsActionsTest-975319395 None] Create snapshot completed successfully Nov 06 14:36:49 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-36d1d89b-a048-4d41-ab3b-fb881cd5dd63 1073741824" returned: 0 in 0.443s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-36d1d89b-a048-4d41-ab3b-fb881cd5dd63 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:49 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-36d1d89b-a048-4d41-ab3b-fb881cd5dd63 Nov 06 14:36:49 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:50 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-36d1d89b-a048-4d41-ab3b-fb881cd5dd63" returned: 0 in 0.257s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.892s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Acquiring lock "cinder-quobyte-c4e304bb-0ff7-4cc4-972c-70389efc2a6d-a52e60fa-3173-49cd-940b-c0e67c1d35d4" by "_create_volume_from_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d44494e-bd0a-4b90-91d2-9962352e8e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36d1d89b-a048-4d41-ab3b-fb881cd5dd63', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f81f42-3d90-428d-818e-1f317e18aced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Lock "cinder-quobyte-c4e304bb-0ff7-4cc4-972c-70389efc2a6d-a52e60fa-3173-49cd-940b-c0e67c1d35d4" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Creating volume a52e60fa-3173-49cd-940b-c0e67c1d35d4 from snapshot c4e304bb-0ff7-4cc4-972c-70389efc2a6d {{(pid=86854) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Acquiring lock "cinder-quobyte-a52e60fa-3173-49cd-940b-c0e67c1d35d4" by "_copy_volume_from_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:50 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Volume volume-36d1d89b-a048-4d41-ab3b-fb881cd5dd63 (36d1d89b-a048-4d41-ab3b-fb881cd5dd63): created successfully Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f81f42-3d90-428d-818e-1f317e18aced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Flow 'volume_create_manager' (968fb371-94a7-432c-85eb-94abb179ccbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Lock "cinder-quobyte-a52e60fa-3173-49cd-940b-c0e67c1d35d4" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] snapshot: c4e304bb-0ff7-4cc4-972c-70389efc2a6d, volume: a52e60fa-3173-49cd-940b-c0e67c1d35d4, {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 14:36:50 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-eff40517-10ce-467f-bb41-da54f9808bbb tempest-ProjectReaderTests-549603794 None] Created volume successfully. Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4032e5b-78ff-4d15-808b-81f29a92fd64]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.c4e304bb-0ff7-4cc4-972c-70389efc2a6d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:50 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.c4e304bb-0ff7-4cc4-972c-70389efc2a6d Nov 06 14:36:50 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c96666da-f241-48ae-be1f-fed87bb44d22 tempest-SnapshotsActionsTest-893473510 None] Acquiring lock "cinder-a185e499-7e8d-4486-a4a1-b2141bab1f9b-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c96666da-f241-48ae-be1f-fed87bb44d22 tempest-SnapshotsActionsTest-893473510 None] Lock "cinder-a185e499-7e8d-4486-a4a1-b2141bab1f9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c96666da-f241-48ae-be1f-fed87bb44d22 tempest-SnapshotsActionsTest-893473510 None] Acquiring lock "cinder-quobyte-982ec8aa-fbfc-4c99-b131-d0e27779b154" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c96666da-f241-48ae-be1f-fed87bb44d22 tempest-SnapshotsActionsTest-893473510 None] Lock "cinder-quobyte-982ec8aa-fbfc-4c99-b131-d0e27779b154" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c96666da-f241-48ae-be1f-fed87bb44d22 tempest-SnapshotsActionsTest-893473510 None] Acquiring lock "cinder-quobyte-a185e499-7e8d-4486-a4a1-b2141bab1f9b" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c96666da-f241-48ae-be1f-fed87bb44d22 tempest-SnapshotsActionsTest-893473510 None] Lock "cinder-quobyte-a185e499-7e8d-4486-a4a1-b2141bab1f9b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-c96666da-f241-48ae-be1f-fed87bb44d22 tempest-SnapshotsActionsTest-893473510 None] Deleting offline snapshot a185e499-7e8d-4486-a4a1-b2141bab1f9b of volume 982ec8aa-fbfc-4c99-b131-d0e27779b154 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-c96666da-f241-48ae-be1f-fed87bb44d22 tempest-SnapshotsActionsTest-893473510 None] snapshot_file for this snap is: volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.a185e499-7e8d-4486-a4a1-b2141bab1f9b {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:36:50 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.c4e304bb-0ff7-4cc4-972c-70389efc2a6d" returned: 0 in 0.404s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83edc27a-654b-4815-86b0-074a4aea2977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c56660e-c356-4f8a-a228-ecf1494a9fd4]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb561cbc-250b-467b-b7c5-5832b8ff3184]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c96666da-f241-48ae-be1f-fed87bb44d22 tempest-SnapshotsActionsTest-893473510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.a185e499-7e8d-4486-a4a1-b2141bab1f9b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f3976562-dc66-448a-bd16-4ca19ec3ff40 tempest-ProjectReaderTests-549603794 None] Acquiring lock "cinder-36d1d89b-a048-4d41-ab3b-fb881cd5dd63-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f3976562-dc66-448a-bd16-4ca19ec3ff40 tempest-ProjectReaderTests-549603794 None] Lock "cinder-36d1d89b-a048-4d41-ab3b-fb881cd5dd63-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:50 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977 Nov 06 14:36:50 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f3976562-dc66-448a-bd16-4ca19ec3ff40 tempest-ProjectReaderTests-549603794 None] Acquiring lock "cinder-quobyte-36d1d89b-a048-4d41-ab3b-fb881cd5dd63" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:50 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.a185e499-7e8d-4486-a4a1-b2141bab1f9b Nov 06 14:36:50 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f3976562-dc66-448a-bd16-4ca19ec3ff40 tempest-ProjectReaderTests-549603794 None] Lock "cinder-quobyte-36d1d89b-a048-4d41-ab3b-fb881cd5dd63" acquired by "delete_volume" :: waited 0.028s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[1066fc91-cf0a-470d-8216-39375d55e495]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f3976562-dc66-448a-bd16-4ca19ec3ff40 tempest-ProjectReaderTests-549603794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-36d1d89b-a048-4d41-ab3b-fb881cd5dd63 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:51 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-36d1d89b-a048-4d41-ab3b-fb881cd5dd63 Nov 06 14:36:51 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:51 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977" returned: 0 in 0.541s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977 {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 14:36:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Creating direct copy from snapshot {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 14:36:51 devstack cinder-volume[86854]: DEBUG cinder.utils [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Path /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a52e60fa-3173-49cd-940b-c0e67c1d35d4 not found in is_blk_device check {{(pid=86854) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 14:36:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a52e60fa-3173-49cd-940b-c0e67c1d35d4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:51 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a52e60fa-3173-49cd-940b-c0e67c1d35d4 Nov 06 14:36:51 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:51 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c96666da-f241-48ae-be1f-fed87bb44d22 tempest-SnapshotsActionsTest-893473510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.a185e499-7e8d-4486-a4a1-b2141bab1f9b" returned: 0 in 0.608s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-c96666da-f241-48ae-be1f-fed87bb44d22 tempest-SnapshotsActionsTest-893473510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-982ec8aa-fbfc-4c99-b131-d0e27779b154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:36:51 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5893d45-7a04-4a85-945c-5836065c4fb3]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c96666da-f241-48ae-be1f-fed87bb44d22 tempest-SnapshotsActionsTest-893473510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:51 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee Nov 06 14:36:51 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:51 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f3976562-dc66-448a-bd16-4ca19ec3ff40 tempest-ProjectReaderTests-549603794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-36d1d89b-a048-4d41-ab3b-fb881cd5dd63" returned: 0 in 0.570s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f3976562-dc66-448a-bd16-4ca19ec3ff40 tempest-ProjectReaderTests-549603794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-36d1d89b-a048-4d41-ab3b-fb881cd5dd63 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:51 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-36d1d89b-a048-4d41-ab3b-fb881cd5dd63 Nov 06 14:36:51 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:51 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f3976562-dc66-448a-bd16-4ca19ec3ff40 tempest-ProjectReaderTests-549603794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-36d1d89b-a048-4d41-ab3b-fb881cd5dd63" returned: 0 in 0.273s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:51 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c96666da-f241-48ae-be1f-fed87bb44d22 tempest-SnapshotsActionsTest-893473510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee" returned: 0 in 0.473s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-c96666da-f241-48ae-be1f-fed87bb44d22 tempest-SnapshotsActionsTest-893473510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-982ec8aa-fbfc-4c99-b131-d0e27779b154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:36:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c96666da-f241-48ae-be1f-fed87bb44d22 tempest-SnapshotsActionsTest-893473510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.a185e499-7e8d-4486-a4a1-b2141bab1f9b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:51 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f3976562-dc66-448a-bd16-4ca19ec3ff40 tempest-ProjectReaderTests-549603794 None] Lock "cinder-quobyte-36d1d89b-a048-4d41-ab3b-fb881cd5dd63" released by "delete_volume" :: held 0.919s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:51 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.a185e499-7e8d-4486-a4a1-b2141bab1f9b Nov 06 14:36:51 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:51 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-f3976562-dc66-448a-bd16-4ca19ec3ff40 tempest-ProjectReaderTests-549603794 None] Created reservations ['db3cba4b-cf24-4aad-9f99-87516bbe5078', '2447aa04-7f6a-489a-9fda-a72f5408a3d1', '49520aea-0799-4c5c-8958-269d31492ff1', '1aeb49db-3bb5-4894-b276-8c1c844fbc7c'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f3976562-dc66-448a-bd16-4ca19ec3ff40 tempest-ProjectReaderTests-549603794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:36:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f3976562-dc66-448a-bd16-4ca19ec3ff40 tempest-ProjectReaderTests-549603794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:36:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f3976562-dc66-448a-bd16-4ca19ec3ff40 tempest-ProjectReaderTests-549603794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:36:52 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f3976562-dc66-448a-bd16-4ca19ec3ff40 tempest-ProjectReaderTests-549603794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:36:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f3976562-dc66-448a-bd16-4ca19ec3ff40 tempest-ProjectReaderTests-549603794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:36:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f3976562-dc66-448a-bd16-4ca19ec3ff40 tempest-ProjectReaderTests-549603794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:52 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:36:52 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:52 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f3976562-dc66-448a-bd16-4ca19ec3ff40 tempest-ProjectReaderTests-549603794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.611s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:52 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-f3976562-dc66-448a-bd16-4ca19ec3ff40 tempest-ProjectReaderTests-549603794 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:36:52 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:52 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-f3976562-dc66-448a-bd16-4ca19ec3ff40 tempest-ProjectReaderTests-549603794 None] Deleted volume successfully. Nov 06 14:36:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c96666da-f241-48ae-be1f-fed87bb44d22 tempest-SnapshotsActionsTest-893473510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.a185e499-7e8d-4486-a4a1-b2141bab1f9b" returned: 0 in 0.963s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c96666da-f241-48ae-be1f-fed87bb44d22 tempest-SnapshotsActionsTest-893473510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.a185e499-7e8d-4486-a4a1-b2141bab1f9b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:52 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.a185e499-7e8d-4486-a4a1-b2141bab1f9b Nov 06 14:36:52 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:52 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f3976562-dc66-448a-bd16-4ca19ec3ff40 tempest-ProjectReaderTests-549603794 None] Lock "cinder-36d1d89b-a048-4d41-ab3b-fb881cd5dd63-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:53 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c96666da-f241-48ae-be1f-fed87bb44d22 tempest-SnapshotsActionsTest-893473510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.a185e499-7e8d-4486-a4a1-b2141bab1f9b" returned: 0 in 0.433s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c96666da-f241-48ae-be1f-fed87bb44d22 tempest-SnapshotsActionsTest-893473510 None] Lock "cinder-quobyte-a185e499-7e8d-4486-a4a1-b2141bab1f9b" released by "_delete_snapshot" :: held 2.678s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c96666da-f241-48ae-be1f-fed87bb44d22 tempest-SnapshotsActionsTest-893473510 None] Lock "cinder-quobyte-982ec8aa-fbfc-4c99-b131-d0e27779b154" released by "delete_snapshot" :: held 2.718s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:53 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-c96666da-f241-48ae-be1f-fed87bb44d22 tempest-SnapshotsActionsTest-893473510 None] Created reservations ['977b8ff5-eb40-4d40-a2c3-0e8182823d84', '087bb9af-92c3-4bab-addb-53b23e829c86', '5dc531ff-c83f-4973-a92c-2e5eb3cebaa3', '072b8b51-5228-4af3-90b2-1805bb1c9b1b'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:53 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-c96666da-f241-48ae-be1f-fed87bb44d22 tempest-SnapshotsActionsTest-893473510 None] Delete snapshot completed successfully. Nov 06 14:36:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c96666da-f241-48ae-be1f-fed87bb44d22 tempest-SnapshotsActionsTest-893473510 None] Lock "cinder-a185e499-7e8d-4486-a4a1-b2141bab1f9b-delete_snapshot" released by "delete_snapshot" :: held 3.093s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:55 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-795bbf18-1a04-467c-a96a-0ba08f76e5b6 tempest-SnapshotsActionsTest-975319395 None] Acquiring lock "cinder-e15ba784-e707-4dcd-a673-4937e50bb9ee-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:55 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-795bbf18-1a04-467c-a96a-0ba08f76e5b6 tempest-SnapshotsActionsTest-975319395 None] Lock "cinder-e15ba784-e707-4dcd-a673-4937e50bb9ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:55 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-795bbf18-1a04-467c-a96a-0ba08f76e5b6 tempest-SnapshotsActionsTest-975319395 None] Acquiring lock "cinder-quobyte-982ec8aa-fbfc-4c99-b131-d0e27779b154" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:55 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-795bbf18-1a04-467c-a96a-0ba08f76e5b6 tempest-SnapshotsActionsTest-975319395 None] Lock "cinder-quobyte-982ec8aa-fbfc-4c99-b131-d0e27779b154" acquired by "delete_snapshot" :: waited 0.163s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:55 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-795bbf18-1a04-467c-a96a-0ba08f76e5b6 tempest-SnapshotsActionsTest-975319395 None] Acquiring lock "cinder-quobyte-e15ba784-e707-4dcd-a673-4937e50bb9ee" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:55 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-795bbf18-1a04-467c-a96a-0ba08f76e5b6 tempest-SnapshotsActionsTest-975319395 None] Lock "cinder-quobyte-e15ba784-e707-4dcd-a673-4937e50bb9ee" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:36:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-795bbf18-1a04-467c-a96a-0ba08f76e5b6 tempest-SnapshotsActionsTest-975319395 None] Deleting offline snapshot e15ba784-e707-4dcd-a673-4937e50bb9ee of volume 982ec8aa-fbfc-4c99-b131-d0e27779b154 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:36:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-795bbf18-1a04-467c-a96a-0ba08f76e5b6 tempest-SnapshotsActionsTest-975319395 None] snapshot_file for this snap is: volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:36:55 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6ab791-3a02-477e-9114-82f9c2a741d0]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-795bbf18-1a04-467c-a96a-0ba08f76e5b6 tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:55 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee Nov 06 14:36:55 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-795bbf18-1a04-467c-a96a-0ba08f76e5b6 tempest-SnapshotsActionsTest-975319395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee" returned: 0 in 0.896s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:56 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:56 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-795bbf18-1a04-467c-a96a-0ba08f76e5b6 tempest-SnapshotsActionsTest-975319395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-982ec8aa-fbfc-4c99-b131-d0e27779b154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:36:56 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1f6d25-de36-4405-a230-b34647aa3553]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:36:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-795bbf18-1a04-467c-a96a-0ba08f76e5b6 tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:56 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154 Nov 06 14:36:56 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:57 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-795bbf18-1a04-467c-a96a-0ba08f76e5b6 tempest-SnapshotsActionsTest-975319395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154" returned: 0 in 1.048s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-795bbf18-1a04-467c-a96a-0ba08f76e5b6 tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:57 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee Nov 06 14:36:57 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:58 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-4060ca2a-1a10-422d-9d6f-bcc068e38bde tempest-GroupsV314Test-831766662 None] Group tempest-GroupsV314Test-Group-222341464: creating Nov 06 14:36:58 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-4060ca2a-1a10-422d-9d6f-bcc068e38bde tempest-GroupsV314Test-831766662 None] Group tempest-GroupsV314Test-Group-222341464: created successfully Nov 06 14:36:58 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-4060ca2a-1a10-422d-9d6f-bcc068e38bde tempest-GroupsV314Test-831766662 None] Create group completed successfully. Nov 06 14:36:58 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-795bbf18-1a04-467c-a96a-0ba08f76e5b6 tempest-SnapshotsActionsTest-975319395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee" returned: 0 in 0.760s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-795bbf18-1a04-467c-a96a-0ba08f76e5b6 tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:58 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee Nov 06 14:36:58 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:58 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-795bbf18-1a04-467c-a96a-0ba08f76e5b6 tempest-SnapshotsActionsTest-975319395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154.e15ba784-e707-4dcd-a673-4937e50bb9ee" returned: 0 in 0.389s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:58 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-795bbf18-1a04-467c-a96a-0ba08f76e5b6 tempest-SnapshotsActionsTest-975319395 None] Lock "cinder-quobyte-e15ba784-e707-4dcd-a673-4937e50bb9ee" released by "_delete_snapshot" :: held 3.388s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:58 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-795bbf18-1a04-467c-a96a-0ba08f76e5b6 tempest-SnapshotsActionsTest-975319395 None] Lock "cinder-quobyte-982ec8aa-fbfc-4c99-b131-d0e27779b154" released by "delete_snapshot" :: held 3.436s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:59 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-795bbf18-1a04-467c-a96a-0ba08f76e5b6 tempest-SnapshotsActionsTest-975319395 None] Created reservations ['2bde0893-7fec-4f2e-8436-fba6a758119e', '1207d76f-ee93-4c74-83c0-b50dd863d913', 'f249c4be-ac54-4893-a42e-81a3eda37442', 'd19575f7-1e42-4ed9-9b8a-a6fa79453569'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:36:59 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-795bbf18-1a04-467c-a96a-0ba08f76e5b6 tempest-SnapshotsActionsTest-975319395 None] Delete snapshot completed successfully. Nov 06 14:36:59 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-795bbf18-1a04-467c-a96a-0ba08f76e5b6 tempest-SnapshotsActionsTest-975319395 None] Lock "cinder-e15ba784-e707-4dcd-a673-4937e50bb9ee-delete_snapshot" released by "delete_snapshot" :: held 3.849s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:36:59 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a52e60fa-3173-49cd-940b-c0e67c1d35d4" returned: 0 in 8.526s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:59 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Image conversion details: src /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977, size 1024.00 MB, duration 8.53 sec, destination /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a52e60fa-3173-49cd-940b-c0e67c1d35d4 {{(pid=86854) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 14:36:59 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Converted 1024.00 MB image at 120.06 MB/s Nov 06 14:36:59 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a52e60fa-3173-49cd-940b-c0e67c1d35d4 is being set with open permissions: ugo+rw Nov 06 14:36:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a52e60fa-3173-49cd-940b-c0e67c1d35d4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:36:59 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a52e60fa-3173-49cd-940b-c0e67c1d35d4 Nov 06 14:36:59 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:36:59 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Nov 06 14:36:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a52e60fa-3173-49cd-940b-c0e67c1d35d4" returned: 0 in 0.302s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:36:59 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-aaf6d3cf-f47d-416d-87c7-ad56b3fd5956 tempest-SnapshotsActionsTest-975319395 None] Acquiring lock "cinder-982ec8aa-fbfc-4c99-b131-d0e27779b154-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:36:59 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Lock "cinder-quobyte-a52e60fa-3173-49cd-940b-c0e67c1d35d4" released by "_copy_volume_from_snapshot" :: held 9.899s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-aaf6d3cf-f47d-416d-87c7-ad56b3fd5956 tempest-SnapshotsActionsTest-975319395 None] Lock "cinder-982ec8aa-fbfc-4c99-b131-d0e27779b154-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Flow 'volume_create_manager' (3341ee59-8cc2-4d1e-990f-8e7b4173e63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6189e201-6d71-4ae0-9cb1-1a55e3995e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6189e201-6d71-4ae0-9cb1-1a55e3995e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2100424157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e5d18ba8-7f83-4a04-8a4d-be825c991e85,host='devstack@QuobyteHD#QuobyteHD',id=699fd5b1-6b92-4ec8-b648-da5618439af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7731d4222d6a40c69be513ef9a2fdc02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:37:00Z,use_quota=True,user_id='995dabb68ecd4f30b03f556beded17bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5281d43d-46a8-492e-921e-f6d06c96b724),volume_type_id=5281d43d-46a8-492e-921e-f6d06c96b724)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd03d1cb-645d-4cda-8489-2769e60d976b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd03d1cb-645d-4cda-8489-2769e60d976b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fca7d34-f433-4012-885a-aaa72b9ac93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fca7d34-f433-4012-885a-aaa72b9ac93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '699fd5b1-6b92-4ec8-b648-da5618439af5', 'volume_name': 'volume-699fd5b1-6b92-4ec8-b648-da5618439af5', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee0cd66-85e0-4ade-ad55-bbd520043279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee0cd66-85e0-4ade-ad55-bbd520043279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e93fe0aa-63ee-4d85-bf11-6c04450baaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:00 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Volume 699fd5b1-6b92-4ec8-b648-da5618439af5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-699fd5b1-6b92-4ec8-b648-da5618439af5', 'volume_size': 1} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Lock "cinder-quobyte-c4e304bb-0ff7-4cc4-972c-70389efc2a6d-a52e60fa-3173-49cd-940b-c0e67c1d35d4" released by "_create_volume_from_snapshot" :: held 10.106s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.139s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e5d18ba8-7f83-4a04-8a4d-be825c991e85,created_at=2026-11-06T13:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2100424157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e5d18ba8-7f83-4a04-8a4d-be825c991e85,host='devstack@QuobyteHD#QuobyteHD',id=699fd5b1-6b92-4ec8-b648-da5618439af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7731d4222d6a40c69be513ef9a2fdc02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:37:00Z,use_quota=True,user_id='995dabb68ecd4f30b03f556beded17bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5281d43d-46a8-492e-921e-f6d06c96b724),volume_type_id=5281d43d-46a8-492e-921e-f6d06c96b724)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Creating volume 699fd5b1-6b92-4ec8-b648-da5618439af5 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:37:00 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-aaf6d3cf-f47d-416d-87c7-ad56b3fd5956 tempest-SnapshotsActionsTest-975319395 None] Acquiring lock "cinder-quobyte-982ec8aa-fbfc-4c99-b131-d0e27779b154" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:37:00 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5 1073741824 Nov 06 14:37:00 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0a39d31-3377-4c63-8517-77c16c8e0ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a52e60fa-3173-49cd-940b-c0e67c1d35d4', 'volume_size': 1, 'snapshot_id': 'c4e304bb-0ff7-4cc4-972c-70389efc2a6d'}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (596135fd-e2a3-485e-be01-ce6bdda924ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-aaf6d3cf-f47d-416d-87c7-ad56b3fd5956 tempest-SnapshotsActionsTest-975319395 None] Lock "cinder-quobyte-982ec8aa-fbfc-4c99-b131-d0e27779b154" acquired by "delete_volume" :: waited 0.038s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:37:00 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Volume volume-a52e60fa-3173-49cd-940b-c0e67c1d35d4 (a52e60fa-3173-49cd-940b-c0e67c1d35d4): created successfully Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (596135fd-e2a3-485e-be01-ce6bdda924ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Flow 'volume_create_manager' (3ba2260e-25cf-4b8b-9963-0b579f85e015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b9bc3b-0eef-4bba-a8b4-8786acdba696]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-aaf6d3cf-f47d-416d-87c7-ad56b3fd5956 tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:00 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-bf442928-f7fe-4eae-8a4b-19027f417fbf tempest-VolumeDependencyTests-783596712 None] Created volume successfully. Nov 06 14:37:00 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154 Nov 06 14:37:00 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:00 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5 1073741824" returned: 0 in 0.512s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:00 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-aaf6d3cf-f47d-416d-87c7-ad56b3fd5956 tempest-SnapshotsActionsTest-975319395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154" returned: 0 in 0.396s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-aaf6d3cf-f47d-416d-87c7-ad56b3fd5956 tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:00 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154 Nov 06 14:37:00 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:00 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5 Nov 06 14:37:00 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:00 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-aaf6d3cf-f47d-416d-87c7-ad56b3fd5956 tempest-SnapshotsActionsTest-975319395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-982ec8aa-fbfc-4c99-b131-d0e27779b154" returned: 0 in 0.288s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:01 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-aaf6d3cf-f47d-416d-87c7-ad56b3fd5956 tempest-SnapshotsActionsTest-975319395 None] Lock "cinder-quobyte-982ec8aa-fbfc-4c99-b131-d0e27779b154" released by "delete_volume" :: held 0.776s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:37:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5" returned: 0 in 0.285s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:01 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:37:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:37:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e93fe0aa-63ee-4d85-bf11-6c04450baaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-699fd5b1-6b92-4ec8-b648-da5618439af5', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6e3689-0bd4-4e2c-a162-b75829e5865f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:01 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Volume volume-699fd5b1-6b92-4ec8-b648-da5618439af5 (699fd5b1-6b92-4ec8-b648-da5618439af5): created successfully Nov 06 14:37:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6e3689-0bd4-4e2c-a162-b75829e5865f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Flow 'volume_create_manager' (3341ee59-8cc2-4d1e-990f-8e7b4173e63b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:37:01 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-e574a820-e3db-43ab-b869-553c6946cdff tempest-GroupsV314Test-831766662 None] Created volume successfully. Nov 06 14:37:01 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-aaf6d3cf-f47d-416d-87c7-ad56b3fd5956 tempest-SnapshotsActionsTest-975319395 None] Created reservations ['5b863225-3237-4089-8730-aae65b0f0b0c', '878849ad-cb63-4820-8f37-d0bdd4acbd89', '2c040867-1bbd-4cd7-80ac-b1dc30e8ba3b', '93fb7042-b8f8-46cf-9ebd-e14dba9c2ffb'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:37:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-aaf6d3cf-f47d-416d-87c7-ad56b3fd5956 tempest-SnapshotsActionsTest-975319395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:37:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-aaf6d3cf-f47d-416d-87c7-ad56b3fd5956 tempest-SnapshotsActionsTest-975319395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:37:01 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-aaf6d3cf-f47d-416d-87c7-ad56b3fd5956 tempest-SnapshotsActionsTest-975319395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:37:01 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-aaf6d3cf-f47d-416d-87c7-ad56b3fd5956 tempest-SnapshotsActionsTest-975319395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:37:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-aaf6d3cf-f47d-416d-87c7-ad56b3fd5956 tempest-SnapshotsActionsTest-975319395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:37:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-aaf6d3cf-f47d-416d-87c7-ad56b3fd5956 tempest-SnapshotsActionsTest-975319395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:01 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:37:01 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a5617886-d93f-47ba-8c29-72d2a13ddcc3 tempest-VolumeDependencyTests-783596712 None] Acquiring lock "cinder-c4e304bb-0ff7-4cc4-972c-70389efc2a6d-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:37:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a5617886-d93f-47ba-8c29-72d2a13ddcc3 tempest-VolumeDependencyTests-783596712 None] Lock "cinder-c4e304bb-0ff7-4cc4-972c-70389efc2a6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:37:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a5617886-d93f-47ba-8c29-72d2a13ddcc3 tempest-VolumeDependencyTests-783596712 None] Acquiring lock "cinder-quobyte-83edc27a-654b-4815-86b0-074a4aea2977" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:37:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a5617886-d93f-47ba-8c29-72d2a13ddcc3 tempest-VolumeDependencyTests-783596712 None] Lock "cinder-quobyte-83edc27a-654b-4815-86b0-074a4aea2977" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:37:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a5617886-d93f-47ba-8c29-72d2a13ddcc3 tempest-VolumeDependencyTests-783596712 None] Acquiring lock "cinder-quobyte-c4e304bb-0ff7-4cc4-972c-70389efc2a6d" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:37:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a5617886-d93f-47ba-8c29-72d2a13ddcc3 tempest-VolumeDependencyTests-783596712 None] Lock "cinder-quobyte-c4e304bb-0ff7-4cc4-972c-70389efc2a6d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:37:01 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-a5617886-d93f-47ba-8c29-72d2a13ddcc3 tempest-VolumeDependencyTests-783596712 None] Deleting offline snapshot c4e304bb-0ff7-4cc4-972c-70389efc2a6d of volume 83edc27a-654b-4815-86b0-074a4aea2977 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:37:01 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-a5617886-d93f-47ba-8c29-72d2a13ddcc3 tempest-VolumeDependencyTests-783596712 None] snapshot_file for this snap is: volume-83edc27a-654b-4815-86b0-074a4aea2977.c4e304bb-0ff7-4cc4-972c-70389efc2a6d {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:37:01 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-aaf6d3cf-f47d-416d-87c7-ad56b3fd5956 tempest-SnapshotsActionsTest-975319395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.379s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:01 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-aaf6d3cf-f47d-416d-87c7-ad56b3fd5956 tempest-SnapshotsActionsTest-975319395 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:37:01 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[7730b593-9237-4681-bb3c-146c542c6480]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:37:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a5617886-d93f-47ba-8c29-72d2a13ddcc3 tempest-VolumeDependencyTests-783596712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.c4e304bb-0ff7-4cc4-972c-70389efc2a6d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:01 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-aaf6d3cf-f47d-416d-87c7-ad56b3fd5956 tempest-SnapshotsActionsTest-975319395 None] Deleted volume successfully. Nov 06 14:37:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-aaf6d3cf-f47d-416d-87c7-ad56b3fd5956 tempest-SnapshotsActionsTest-975319395 None] Lock "cinder-982ec8aa-fbfc-4c99-b131-d0e27779b154-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:37:01 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.c4e304bb-0ff7-4cc4-972c-70389efc2a6d Nov 06 14:37:01 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:37:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:37:02 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Cloning volume 699fd5b1-6b92-4ec8-b648-da5618439af5 to volume 6360a68b-b75f-4824-a6d1-81038191ba91 Nov 06 14:37:02 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Creating offline snapshot 36c8e36b-63d6-4946-8989-87300bc9838d of volume 699fd5b1-6b92-4ec8-b648-da5618439af5 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:37:02 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ec0c9b-99ed-4f58-9ef0-8c948c150f37]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:37:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:02 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a5617886-d93f-47ba-8c29-72d2a13ddcc3 tempest-VolumeDependencyTests-783596712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.c4e304bb-0ff7-4cc4-972c-70389efc2a6d" returned: 0 in 0.510s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:02 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-a5617886-d93f-47ba-8c29-72d2a13ddcc3 tempest-VolumeDependencyTests-783596712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83edc27a-654b-4815-86b0-074a4aea2977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:37:02 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6a8515-382b-4902-a58c-aeaf199bce49]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:37:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a5617886-d93f-47ba-8c29-72d2a13ddcc3 tempest-VolumeDependencyTests-783596712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:02 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5 Nov 06 14:37:02 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:02 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977 Nov 06 14:37:02 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:02 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5" returned: 0 in 0.497s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.36c8e36b-63d6-4946-8989-87300bc9838d 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:02 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.36c8e36b-63d6-4946-8989-87300bc9838d 1G Nov 06 14:37:02 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:02 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a5617886-d93f-47ba-8c29-72d2a13ddcc3 tempest-VolumeDependencyTests-783596712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977" returned: 0 in 0.747s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a5617886-d93f-47ba-8c29-72d2a13ddcc3 tempest-VolumeDependencyTests-783596712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.c4e304bb-0ff7-4cc4-972c-70389efc2a6d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:02 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.c4e304bb-0ff7-4cc4-972c-70389efc2a6d Nov 06 14:37:02 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:03 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.36c8e36b-63d6-4946-8989-87300bc9838d 1G" returned: 0 in 0.722s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-699fd5b1-6b92-4ec8-b648-da5618439af5 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.36c8e36b-63d6-4946-8989-87300bc9838d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:03 devstack sudo[99730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-699fd5b1-6b92-4ec8-b648-da5618439af5 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.36c8e36b-63d6-4946-8989-87300bc9838d Nov 06 14:37:03 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:03 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a5617886-d93f-47ba-8c29-72d2a13ddcc3 tempest-VolumeDependencyTests-783596712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.c4e304bb-0ff7-4cc4-972c-70389efc2a6d" returned: 0 in 0.617s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a5617886-d93f-47ba-8c29-72d2a13ddcc3 tempest-VolumeDependencyTests-783596712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.c4e304bb-0ff7-4cc4-972c-70389efc2a6d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:03 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.c4e304bb-0ff7-4cc4-972c-70389efc2a6d Nov 06 14:37:03 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:03 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-699fd5b1-6b92-4ec8-b648-da5618439af5 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.36c8e36b-63d6-4946-8989-87300bc9838d" returned: 0 in 0.424s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:03 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.36c8e36b-63d6-4946-8989-87300bc9838d is being set with open permissions: ugo+rw: NotImplementedError Nov 06 14:37:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.36c8e36b-63d6-4946-8989-87300bc9838d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:03 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.36c8e36b-63d6-4946-8989-87300bc9838d Nov 06 14:37:03 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:03 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a5617886-d93f-47ba-8c29-72d2a13ddcc3 tempest-VolumeDependencyTests-783596712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977.c4e304bb-0ff7-4cc4-972c-70389efc2a6d" returned: 0 in 0.376s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:03 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a5617886-d93f-47ba-8c29-72d2a13ddcc3 tempest-VolumeDependencyTests-783596712 None] Lock "cinder-quobyte-c4e304bb-0ff7-4cc4-972c-70389efc2a6d" released by "_delete_snapshot" :: held 2.428s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:37:03 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a5617886-d93f-47ba-8c29-72d2a13ddcc3 tempest-VolumeDependencyTests-783596712 None] Lock "cinder-quobyte-83edc27a-654b-4815-86b0-074a4aea2977" released by "delete_snapshot" :: held 2.463s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:37:04 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.36c8e36b-63d6-4946-8989-87300bc9838d" returned: 0 in 0.309s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:04 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-a5617886-d93f-47ba-8c29-72d2a13ddcc3 tempest-VolumeDependencyTests-783596712 None] Created reservations ['9feb8542-87da-41ea-aa0d-eb3d350b65c0', 'fc49bab2-12af-46bd-b422-466b3dd5a721', '7bbbb686-61f1-4c4b-90b0-d2e544beeb9b', 'd97f3783-806d-4b9b-af3b-a76e21e8d60d'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:37:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:04 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.info Nov 06 14:37:04 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:04 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-a5617886-d93f-47ba-8c29-72d2a13ddcc3 tempest-VolumeDependencyTests-783596712 None] Delete snapshot completed successfully. Nov 06 14:37:04 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a5617886-d93f-47ba-8c29-72d2a13ddcc3 tempest-VolumeDependencyTests-783596712 None] Lock "cinder-c4e304bb-0ff7-4cc4-972c-70389efc2a6d-delete_snapshot" released by "delete_snapshot" :: held 2.705s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:37:04 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.info" returned: 0 in 0.349s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:04 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 14:37:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:04 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.info Nov 06 14:37:04 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:04 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.info" returned: 0 in 0.251s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:04 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Acquiring lock "cinder-quobyte-6360a68b-b75f-4824-a6d1-81038191ba91" by "_copy_volume_from_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:37:04 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Lock "cinder-quobyte-6360a68b-b75f-4824-a6d1-81038191ba91" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:37:04 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] snapshot: 36c8e36b-63d6-4946-8989-87300bc9838d, volume: 6360a68b-b75f-4824-a6d1-81038191ba91, {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 14:37:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:37:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:37:04 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:37:04 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:37:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:37:04 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-181f69be-4a04-4e87-9e06-3e94d6e753ca tempest-VolumeDependencyTests-783596712 None] Acquiring lock "cinder-83edc27a-654b-4815-86b0-074a4aea2977-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:37:04 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c68036b-d7f5-4d4b-9c4d-ff68190461bc]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:37:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.36c8e36b-63d6-4946-8989-87300bc9838d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:04 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-181f69be-4a04-4e87-9e06-3e94d6e753ca tempest-VolumeDependencyTests-783596712 None] Lock "cinder-83edc27a-654b-4815-86b0-074a4aea2977-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:37:04 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-181f69be-4a04-4e87-9e06-3e94d6e753ca tempest-VolumeDependencyTests-783596712 None] Acquiring lock "cinder-quobyte-83edc27a-654b-4815-86b0-074a4aea2977" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:37:04 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-181f69be-4a04-4e87-9e06-3e94d6e753ca tempest-VolumeDependencyTests-783596712 None] Lock "cinder-quobyte-83edc27a-654b-4815-86b0-074a4aea2977" acquired by "delete_volume" :: waited 0.018s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:37:04 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.36c8e36b-63d6-4946-8989-87300bc9838d Nov 06 14:37:04 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:04 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[81364496-5cf7-456f-b901-a38f7b2d92f0]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:37:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-181f69be-4a04-4e87-9e06-3e94d6e753ca tempest-VolumeDependencyTests-783596712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:05 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977 Nov 06 14:37:05 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:05 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.36c8e36b-63d6-4946-8989-87300bc9838d" returned: 0 in 0.412s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-699fd5b1-6b92-4ec8-b648-da5618439af5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:37:05 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f408e2e-7109-4220-a939-1769a91a026e]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:37:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:05 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-181f69be-4a04-4e87-9e06-3e94d6e753ca tempest-VolumeDependencyTests-783596712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977" returned: 0 in 0.392s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-181f69be-4a04-4e87-9e06-3e94d6e753ca tempest-VolumeDependencyTests-783596712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:05 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5 Nov 06 14:37:05 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:05 devstack sudo[99760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977 Nov 06 14:37:05 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:05 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-181f69be-4a04-4e87-9e06-3e94d6e753ca tempest-VolumeDependencyTests-783596712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-83edc27a-654b-4815-86b0-074a4aea2977" returned: 0 in 0.263s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:05 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5" returned: 0 in 0.402s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5 {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 14:37:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Creating direct copy from snapshot {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 14:37:05 devstack cinder-volume[86854]: DEBUG cinder.utils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Path /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6360a68b-b75f-4824-a6d1-81038191ba91 not found in is_blk_device check {{(pid=86854) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 14:37:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6360a68b-b75f-4824-a6d1-81038191ba91 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:05 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-181f69be-4a04-4e87-9e06-3e94d6e753ca tempest-VolumeDependencyTests-783596712 None] Lock "cinder-quobyte-83edc27a-654b-4815-86b0-074a4aea2977" released by "delete_volume" :: held 0.759s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:37:05 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6360a68b-b75f-4824-a6d1-81038191ba91 Nov 06 14:37:05 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:05 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-181f69be-4a04-4e87-9e06-3e94d6e753ca tempest-VolumeDependencyTests-783596712 None] Created reservations ['2feb64f1-f20c-49ee-a1aa-25323a4dd9cf', '35b1621f-1131-4687-a159-3414bd54b104', '2147b51f-e541-45c0-9048-9d179d8e0466', '4438962a-bb98-4b35-994e-04d122404077'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:37:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-181f69be-4a04-4e87-9e06-3e94d6e753ca tempest-VolumeDependencyTests-783596712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:37:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-181f69be-4a04-4e87-9e06-3e94d6e753ca tempest-VolumeDependencyTests-783596712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:37:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-181f69be-4a04-4e87-9e06-3e94d6e753ca tempest-VolumeDependencyTests-783596712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:37:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-181f69be-4a04-4e87-9e06-3e94d6e753ca tempest-VolumeDependencyTests-783596712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:37:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-181f69be-4a04-4e87-9e06-3e94d6e753ca tempest-VolumeDependencyTests-783596712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:37:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-181f69be-4a04-4e87-9e06-3e94d6e753ca tempest-VolumeDependencyTests-783596712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:05 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:37:05 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:06 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4f51b9be-9177-4d98-a785-31c96847be7e tempest-VolumeDependencyTests-783596712 None] Acquiring lock "cinder-a52e60fa-3173-49cd-940b-c0e67c1d35d4-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:37:06 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4f51b9be-9177-4d98-a785-31c96847be7e tempest-VolumeDependencyTests-783596712 None] Lock "cinder-a52e60fa-3173-49cd-940b-c0e67c1d35d4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:37:06 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4f51b9be-9177-4d98-a785-31c96847be7e tempest-VolumeDependencyTests-783596712 None] Acquiring lock "cinder-quobyte-a52e60fa-3173-49cd-940b-c0e67c1d35d4" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:37:06 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-181f69be-4a04-4e87-9e06-3e94d6e753ca tempest-VolumeDependencyTests-783596712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.328s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:06 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-181f69be-4a04-4e87-9e06-3e94d6e753ca tempest-VolumeDependencyTests-783596712 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:37:06 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4f51b9be-9177-4d98-a785-31c96847be7e tempest-VolumeDependencyTests-783596712 None] Lock "cinder-quobyte-a52e60fa-3173-49cd-940b-c0e67c1d35d4" acquired by "delete_volume" :: waited 0.029s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:37:06 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-181f69be-4a04-4e87-9e06-3e94d6e753ca tempest-VolumeDependencyTests-783596712 None] Deleted volume successfully. Nov 06 14:37:06 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[949abf58-796a-4123-abb3-08e593528063]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:37:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4f51b9be-9177-4d98-a785-31c96847be7e tempest-VolumeDependencyTests-783596712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a52e60fa-3173-49cd-940b-c0e67c1d35d4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:06 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-181f69be-4a04-4e87-9e06-3e94d6e753ca tempest-VolumeDependencyTests-783596712 None] Lock "cinder-83edc27a-654b-4815-86b0-074a4aea2977-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:37:06 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a52e60fa-3173-49cd-940b-c0e67c1d35d4 Nov 06 14:37:06 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:06 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4f51b9be-9177-4d98-a785-31c96847be7e tempest-VolumeDependencyTests-783596712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a52e60fa-3173-49cd-940b-c0e67c1d35d4" returned: 0 in 0.811s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4f51b9be-9177-4d98-a785-31c96847be7e tempest-VolumeDependencyTests-783596712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a52e60fa-3173-49cd-940b-c0e67c1d35d4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:07 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a52e60fa-3173-49cd-940b-c0e67c1d35d4 Nov 06 14:37:07 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:07 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4f51b9be-9177-4d98-a785-31c96847be7e tempest-VolumeDependencyTests-783596712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a52e60fa-3173-49cd-940b-c0e67c1d35d4" returned: 0 in 0.537s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:07 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4f51b9be-9177-4d98-a785-31c96847be7e tempest-VolumeDependencyTests-783596712 None] Lock "cinder-quobyte-a52e60fa-3173-49cd-940b-c0e67c1d35d4" released by "delete_volume" :: held 1.419s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:37:07 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-4f51b9be-9177-4d98-a785-31c96847be7e tempest-VolumeDependencyTests-783596712 None] Created reservations ['aa404e7b-768c-4480-9b5c-3e5d9dc2a57a', 'bc87a924-dfa9-43ac-b320-858f6f765641', 'a9ee0d13-b101-476a-91ad-615bc6711cfb', 'ddf78fb8-0e08-4fdf-be5f-9fac6c5c34af'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:37:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4f51b9be-9177-4d98-a785-31c96847be7e tempest-VolumeDependencyTests-783596712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:37:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4f51b9be-9177-4d98-a785-31c96847be7e tempest-VolumeDependencyTests-783596712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:37:07 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4f51b9be-9177-4d98-a785-31c96847be7e tempest-VolumeDependencyTests-783596712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:37:07 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4f51b9be-9177-4d98-a785-31c96847be7e tempest-VolumeDependencyTests-783596712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:37:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4f51b9be-9177-4d98-a785-31c96847be7e tempest-VolumeDependencyTests-783596712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:37:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4f51b9be-9177-4d98-a785-31c96847be7e tempest-VolumeDependencyTests-783596712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:07 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:37:07 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:08 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4f51b9be-9177-4d98-a785-31c96847be7e tempest-VolumeDependencyTests-783596712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.583s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:08 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-4f51b9be-9177-4d98-a785-31c96847be7e tempest-VolumeDependencyTests-783596712 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:37:08 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-4f51b9be-9177-4d98-a785-31c96847be7e tempest-VolumeDependencyTests-783596712 None] Deleted volume successfully. Nov 06 14:37:08 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4f51b9be-9177-4d98-a785-31c96847be7e tempest-VolumeDependencyTests-783596712 None] Lock "cinder-a52e60fa-3173-49cd-940b-c0e67c1d35d4-delete_volume" released by "delete_volume" :: held 2.491s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:37:10 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:37:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Flow 'volume_create_manager' (4b2d378b-aff4-4ba2-9a65-506e33c9e575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:37:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d41381ee-4682-4e86-9b79-fc6471f07ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d41381ee-4682-4e86-9b79-fc6471f07ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2003692418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81ffa345-31f6-4e74-94fe-14473f488096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46ef73591c94dbe84f27b4cb3c23e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:37:10Z,use_quota=True,user_id='d94567b77e67481e832d6ffc404a3b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd1cadd-625e-4f9f-a4c9-3b2036aef0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd1cadd-625e-4f9f-a4c9-3b2036aef0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726b8871-61de-421a-8778-59a6b4ba1b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726b8871-61de-421a-8778-59a6b4ba1b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81ffa345-31f6-4e74-94fe-14473f488096', 'volume_name': 'volume-81ffa345-31f6-4e74-94fe-14473f488096', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd08d96-838c-430a-84cb-119d19466bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd08d96-838c-430a-84cb-119d19466bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6647711-6a63-448c-97b6-3596e64a2cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:10 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Volume 81ffa345-31f6-4e74-94fe-14473f488096: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81ffa345-31f6-4e74-94fe-14473f488096', 'volume_size': 1} Nov 06 14:37:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:37:13 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6360a68b-b75f-4824-a6d1-81038191ba91" returned: 0 in 8.114s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:13 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Image conversion details: src /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5, size 1024.00 MB, duration 8.12 sec, destination /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6360a68b-b75f-4824-a6d1-81038191ba91 {{(pid=86854) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 14:37:13 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Converted 1024.00 MB image at 126.18 MB/s Nov 06 14:37:13 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6360a68b-b75f-4824-a6d1-81038191ba91 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 14:37:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6360a68b-b75f-4824-a6d1-81038191ba91 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:13 devstack sudo[99839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6360a68b-b75f-4824-a6d1-81038191ba91 Nov 06 14:37:13 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:13 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6360a68b-b75f-4824-a6d1-81038191ba91" returned: 0 in 0.241s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:14 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Lock "cinder-quobyte-6360a68b-b75f-4824-a6d1-81038191ba91" released by "_copy_volume_from_snapshot" :: held 9.274s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:37:14 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Acquiring lock "cinder-quobyte-36c8e36b-63d6-4946-8989-87300bc9838d" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:37:14 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Lock "cinder-quobyte-36c8e36b-63d6-4946-8989-87300bc9838d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:37:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Deleting offline snapshot 36c8e36b-63d6-4946-8989-87300bc9838d of volume 699fd5b1-6b92-4ec8-b648-da5618439af5 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:37:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] snapshot_file for this snap is: volume-699fd5b1-6b92-4ec8-b648-da5618439af5.36c8e36b-63d6-4946-8989-87300bc9838d {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:37:14 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9019611-1705-46f9-b72d-f30c48142ca4]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:37:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.36c8e36b-63d6-4946-8989-87300bc9838d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:14 devstack sudo[99842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.36c8e36b-63d6-4946-8989-87300bc9838d Nov 06 14:37:14 devstack sudo[99842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:14 devstack sudo[99842]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.36c8e36b-63d6-4946-8989-87300bc9838d" returned: 0 in 0.404s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-699fd5b1-6b92-4ec8-b648-da5618439af5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:37:14 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7326266-278b-43c1-bab1-220d7ffab9e5]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:37:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:14 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5 Nov 06 14:37:14 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:15 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5" returned: 0 in 0.563s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.36c8e36b-63d6-4946-8989-87300bc9838d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:15 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.36c8e36b-63d6-4946-8989-87300bc9838d Nov 06 14:37:15 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:15 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.36c8e36b-63d6-4946-8989-87300bc9838d" returned: 0 in 0.356s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.36c8e36b-63d6-4946-8989-87300bc9838d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:15 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.36c8e36b-63d6-4946-8989-87300bc9838d Nov 06 14:37:15 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:15 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5.36c8e36b-63d6-4946-8989-87300bc9838d" returned: 0 in 0.248s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:15 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Lock "cinder-quobyte-36c8e36b-63d6-4946-8989-87300bc9838d" released by "_delete_snapshot" :: held 1.676s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:37:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.726s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:37:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.350s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:37:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2003692418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81ffa345-31f6-4e74-94fe-14473f488096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46ef73591c94dbe84f27b4cb3c23e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:37:10Z,use_quota=True,user_id='d94567b77e67481e832d6ffc404a3b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:37:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Creating volume 81ffa345-31f6-4e74-94fe-14473f488096 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:37:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:37:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:37:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:37:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:37:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:37:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:37:15 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:37:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-81ffa345-31f6-4e74-94fe-14473f488096 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:15 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-81ffa345-31f6-4e74-94fe-14473f488096 1073741824 Nov 06 14:37:15 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:15 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-74f03977-f524-4387-a0fd-0623a2bbd408 tempest-GroupsV314Test-831766662 None] Create group from source-group-e5d18ba8-7f83-4a04-8a4d-be825c991e85 completed successfully. Nov 06 14:37:16 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-81ffa345-31f6-4e74-94fe-14473f488096 1073741824" returned: 0 in 0.446s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-81ffa345-31f6-4e74-94fe-14473f488096 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:16 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-81ffa345-31f6-4e74-94fe-14473f488096 Nov 06 14:37:16 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:16 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-81ffa345-31f6-4e74-94fe-14473f488096" returned: 0 in 0.273s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:37:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:37:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6647711-6a63-448c-97b6-3596e64a2cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81ffa345-31f6-4e74-94fe-14473f488096', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a08dbeba-548b-4cef-898a-3f65a31303cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:16 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Volume volume-81ffa345-31f6-4e74-94fe-14473f488096 (81ffa345-31f6-4e74-94fe-14473f488096): created successfully Nov 06 14:37:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a08dbeba-548b-4cef-898a-3f65a31303cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Flow 'volume_create_manager' (4b2d378b-aff4-4ba2-9a65-506e33c9e575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:37:16 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-d44c8f1f-dc93-4b4f-91c9-cc77f796aff4 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Created volume successfully. Nov 06 14:37:17 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-03ed8034-ea5f-47a7-98ad-9d123fb42df6 tempest-GroupsV314Test-831766662 None] Acquiring lock "cinder-quobyte-6360a68b-b75f-4824-a6d1-81038191ba91" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:37:17 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-03ed8034-ea5f-47a7-98ad-9d123fb42df6 tempest-GroupsV314Test-831766662 None] Lock "cinder-quobyte-6360a68b-b75f-4824-a6d1-81038191ba91" acquired by "delete_volume" :: waited 0.022s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:37:17 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bbfaf5-c952-4862-a32e-11a00ac9cc0b]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:37:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-03ed8034-ea5f-47a7-98ad-9d123fb42df6 tempest-GroupsV314Test-831766662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6360a68b-b75f-4824-a6d1-81038191ba91 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:17 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6360a68b-b75f-4824-a6d1-81038191ba91 Nov 06 14:37:17 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:17 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-03ed8034-ea5f-47a7-98ad-9d123fb42df6 tempest-GroupsV314Test-831766662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6360a68b-b75f-4824-a6d1-81038191ba91" returned: 0 in 0.424s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-03ed8034-ea5f-47a7-98ad-9d123fb42df6 tempest-GroupsV314Test-831766662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6360a68b-b75f-4824-a6d1-81038191ba91 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:17 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6360a68b-b75f-4824-a6d1-81038191ba91 Nov 06 14:37:17 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:17 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-03ed8034-ea5f-47a7-98ad-9d123fb42df6 tempest-GroupsV314Test-831766662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6360a68b-b75f-4824-a6d1-81038191ba91" returned: 0 in 0.266s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:17 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-03ed8034-ea5f-47a7-98ad-9d123fb42df6 tempest-GroupsV314Test-831766662 None] Lock "cinder-quobyte-6360a68b-b75f-4824-a6d1-81038191ba91" released by "delete_volume" :: held 0.747s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:37:17 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-03ed8034-ea5f-47a7-98ad-9d123fb42df6 tempest-GroupsV314Test-831766662 None] Created reservations ['cd88af36-305b-4db8-91fa-e2a718238171'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:37:17 devstack cinder-volume[86854]: WARNING cinder.quota [None req-03ed8034-ea5f-47a7-98ad-9d123fb42df6 tempest-GroupsV314Test-831766662 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-432629096 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-432629096, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:37:17 devstack cinder-volume[86854]: WARNING cinder.quota [None req-03ed8034-ea5f-47a7-98ad-9d123fb42df6 tempest-GroupsV314Test-831766662 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-432629096 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-432629096, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:37:17 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-03ed8034-ea5f-47a7-98ad-9d123fb42df6 tempest-GroupsV314Test-831766662 None] Created reservations ['cb9f5628-1d0d-4dfc-960a-ddd0f4158e92', '0b7a5b00-7735-440a-b5c1-fdb7b395bd71', 'cde945c5-ba88-4b12-a342-ffc2f8834663', '6a643ce5-8503-4e6d-a7a3-60acfe159332'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:37:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-03ed8034-ea5f-47a7-98ad-9d123fb42df6 tempest-GroupsV314Test-831766662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:37:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-03ed8034-ea5f-47a7-98ad-9d123fb42df6 tempest-GroupsV314Test-831766662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:37:18 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-03ed8034-ea5f-47a7-98ad-9d123fb42df6 tempest-GroupsV314Test-831766662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:37:18 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-03ed8034-ea5f-47a7-98ad-9d123fb42df6 tempest-GroupsV314Test-831766662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:37:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-03ed8034-ea5f-47a7-98ad-9d123fb42df6 tempest-GroupsV314Test-831766662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:37:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-03ed8034-ea5f-47a7-98ad-9d123fb42df6 tempest-GroupsV314Test-831766662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:18 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:37:18 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:18 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-03ed8034-ea5f-47a7-98ad-9d123fb42df6 tempest-GroupsV314Test-831766662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.268s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:18 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-03ed8034-ea5f-47a7-98ad-9d123fb42df6 tempest-GroupsV314Test-831766662 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:37:18 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-03ed8034-ea5f-47a7-98ad-9d123fb42df6 tempest-GroupsV314Test-831766662 None] Delete group completed successfully. Nov 06 14:37:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-af75bb04-94f9-45c5-b665-094fc574645a tempest-GroupsV314Test-831766662 None] Acquiring lock "cinder-quobyte-699fd5b1-6b92-4ec8-b648-da5618439af5" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:37:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-af75bb04-94f9-45c5-b665-094fc574645a tempest-GroupsV314Test-831766662 None] Lock "cinder-quobyte-699fd5b1-6b92-4ec8-b648-da5618439af5" acquired by "delete_volume" :: waited 0.019s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:37:18 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[6255e0e0-3586-4c37-b8c9-36de3545e772]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:37:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-af75bb04-94f9-45c5-b665-094fc574645a tempest-GroupsV314Test-831766662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:18 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5 Nov 06 14:37:18 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d4e9f052-9f06-4c9e-a922-aa9d28cc67c3 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Acquiring lock "cinder-81ffa345-31f6-4e74-94fe-14473f488096-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:37:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d4e9f052-9f06-4c9e-a922-aa9d28cc67c3 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Lock "cinder-81ffa345-31f6-4e74-94fe-14473f488096-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:37:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d4e9f052-9f06-4c9e-a922-aa9d28cc67c3 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Acquiring lock "cinder-quobyte-81ffa345-31f6-4e74-94fe-14473f488096" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:37:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d4e9f052-9f06-4c9e-a922-aa9d28cc67c3 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Lock "cinder-quobyte-81ffa345-31f6-4e74-94fe-14473f488096" acquired by "delete_volume" :: waited 0.018s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:37:18 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[2714d3a9-098d-42dc-b183-ad3a87632c75]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:37:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d4e9f052-9f06-4c9e-a922-aa9d28cc67c3 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-81ffa345-31f6-4e74-94fe-14473f488096 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:18 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-af75bb04-94f9-45c5-b665-094fc574645a tempest-GroupsV314Test-831766662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5" returned: 0 in 0.389s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-af75bb04-94f9-45c5-b665-094fc574645a tempest-GroupsV314Test-831766662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:19 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5 Nov 06 14:37:19 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:19 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-81ffa345-31f6-4e74-94fe-14473f488096 Nov 06 14:37:19 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:19 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-af75bb04-94f9-45c5-b665-094fc574645a tempest-GroupsV314Test-831766662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-699fd5b1-6b92-4ec8-b648-da5618439af5" returned: 0 in 0.245s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-af75bb04-94f9-45c5-b665-094fc574645a tempest-GroupsV314Test-831766662 None] Lock "cinder-quobyte-699fd5b1-6b92-4ec8-b648-da5618439af5" released by "delete_volume" :: held 0.705s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:37:19 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d4e9f052-9f06-4c9e-a922-aa9d28cc67c3 tempest-VolumeQuotasNegativeTestJSON-784447376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-81ffa345-31f6-4e74-94fe-14473f488096" returned: 0 in 0.368s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d4e9f052-9f06-4c9e-a922-aa9d28cc67c3 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-81ffa345-31f6-4e74-94fe-14473f488096 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:19 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-af75bb04-94f9-45c5-b665-094fc574645a tempest-GroupsV314Test-831766662 None] Created reservations ['cf067cd0-1563-4f28-956c-35ea10c49d14'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:37:19 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-81ffa345-31f6-4e74-94fe-14473f488096 Nov 06 14:37:19 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:19 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-af75bb04-94f9-45c5-b665-094fc574645a tempest-GroupsV314Test-831766662 None] Created reservations ['1ffd9131-bde9-4af1-9d81-269bc04f018f', '83b57fb5-a6ff-412b-a06a-1b2febee038a', 'cc2064f2-3189-4833-b548-3efc3d5e4804', 'eb108d93-8ced-4712-b6df-40617a1464af'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:37:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-af75bb04-94f9-45c5-b665-094fc574645a tempest-GroupsV314Test-831766662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:37:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-af75bb04-94f9-45c5-b665-094fc574645a tempest-GroupsV314Test-831766662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:37:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-af75bb04-94f9-45c5-b665-094fc574645a tempest-GroupsV314Test-831766662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:37:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-af75bb04-94f9-45c5-b665-094fc574645a tempest-GroupsV314Test-831766662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:37:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-af75bb04-94f9-45c5-b665-094fc574645a tempest-GroupsV314Test-831766662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:37:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-af75bb04-94f9-45c5-b665-094fc574645a tempest-GroupsV314Test-831766662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:19 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:37:19 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:19 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d4e9f052-9f06-4c9e-a922-aa9d28cc67c3 tempest-VolumeQuotasNegativeTestJSON-784447376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-81ffa345-31f6-4e74-94fe-14473f488096" returned: 0 in 0.243s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d4e9f052-9f06-4c9e-a922-aa9d28cc67c3 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Lock "cinder-quobyte-81ffa345-31f6-4e74-94fe-14473f488096" released by "delete_volume" :: held 0.651s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:37:19 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-d4e9f052-9f06-4c9e-a922-aa9d28cc67c3 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Created reservations ['4025351f-1622-4b09-af40-4e6ae727cb46', '76caf457-021c-4e14-92d0-5e8107ab4451', 'af382948-3ec1-4b75-a418-d8833ed4f743', '5b0b41ea-b97b-4169-a343-fe4d4cc06938'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:37:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d4e9f052-9f06-4c9e-a922-aa9d28cc67c3 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:37:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d4e9f052-9f06-4c9e-a922-aa9d28cc67c3 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:37:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d4e9f052-9f06-4c9e-a922-aa9d28cc67c3 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:37:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d4e9f052-9f06-4c9e-a922-aa9d28cc67c3 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:37:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d4e9f052-9f06-4c9e-a922-aa9d28cc67c3 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:37:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d4e9f052-9f06-4c9e-a922-aa9d28cc67c3 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:19 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:37:19 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:19 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-af75bb04-94f9-45c5-b665-094fc574645a tempest-GroupsV314Test-831766662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.266s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:19 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-af75bb04-94f9-45c5-b665-094fc574645a tempest-GroupsV314Test-831766662 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:37:19 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-af75bb04-94f9-45c5-b665-094fc574645a tempest-GroupsV314Test-831766662 None] Delete group completed successfully. Nov 06 14:37:19 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d4e9f052-9f06-4c9e-a922-aa9d28cc67c3 tempest-VolumeQuotasNegativeTestJSON-784447376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.268s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:19 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-d4e9f052-9f06-4c9e-a922-aa9d28cc67c3 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:37:19 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-d4e9f052-9f06-4c9e-a922-aa9d28cc67c3 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Deleted volume successfully. Nov 06 14:37:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d4e9f052-9f06-4c9e-a922-aa9d28cc67c3 tempest-VolumeQuotasNegativeTestJSON-784447376 None] Lock "cinder-81ffa345-31f6-4e74-94fe-14473f488096-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:37:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:37:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:37:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:37:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:37:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:37:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:37:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:23 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:37:23 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:23 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.287s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:23 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:37:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager._thread_info {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:37:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread count: 28 {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 14:37:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread info: [<_MainThread(MainThread, started 130306900594816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 14:37:26 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:37:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Flow 'volume_create_manager' (c11622cf-94e6-47f8-8fea-7ac75c4427f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:37:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9df5b812-992a-44b0-9248-ec6ee041a618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9df5b812-992a-44b0-9248-ec6ee041a618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-801497028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b0063b3-cbac-499e-8d58-82081272d1bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8985d8c28a44ab484929e764f8e3863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:37:26Z,use_quota=True,user_id='bc9f7111f3fa47de8ffa9f0348bd7425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f9213da-026c-44f7-9375-33caf654d045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f9213da-026c-44f7-9375-33caf654d045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0441e0eb-7ca5-4207-8bb5-48d6cbb407d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0441e0eb-7ca5-4207-8bb5-48d6cbb407d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b0063b3-cbac-499e-8d58-82081272d1bf', 'volume_name': 'volume-2b0063b3-cbac-499e-8d58-82081272d1bf', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d07417ed-f0a1-499b-ad2b-31bd3efd9c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d07417ed-f0a1-499b-ad2b-31bd3efd9c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f981cbf-ca99-498c-914a-ee37ffe48ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:26 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Volume 2b0063b3-cbac-499e-8d58-82081272d1bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b0063b3-cbac-499e-8d58-82081272d1bf', 'volume_size': 1} Nov 06 14:37:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:37:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:37:26 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-801497028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b0063b3-cbac-499e-8d58-82081272d1bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8985d8c28a44ab484929e764f8e3863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:37:26Z,use_quota=True,user_id='bc9f7111f3fa47de8ffa9f0348bd7425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:37:26 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Creating volume 2b0063b3-cbac-499e-8d58-82081272d1bf {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:37:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:37:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:37:26 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:37:26 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:37:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:37:26 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:37:26 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:37:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2b0063b3-cbac-499e-8d58-82081272d1bf 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:26 devstack sudo[99907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2b0063b3-cbac-499e-8d58-82081272d1bf 1073741824 Nov 06 14:37:26 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:26 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2b0063b3-cbac-499e-8d58-82081272d1bf 1073741824" returned: 0 in 0.423s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2b0063b3-cbac-499e-8d58-82081272d1bf {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:26 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2b0063b3-cbac-499e-8d58-82081272d1bf Nov 06 14:37:26 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:27 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2b0063b3-cbac-499e-8d58-82081272d1bf" returned: 0 in 0.251s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:27 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:37:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:37:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f981cbf-ca99-498c-914a-ee37ffe48ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b0063b3-cbac-499e-8d58-82081272d1bf', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca2fc1c-eacc-4af6-8d36-c0fc8e08020f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:27 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Volume volume-2b0063b3-cbac-499e-8d58-82081272d1bf (2b0063b3-cbac-499e-8d58-82081272d1bf): created successfully Nov 06 14:37:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca2fc1c-eacc-4af6-8d36-c0fc8e08020f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Flow 'volume_create_manager' (c11622cf-94e6-47f8-8fea-7ac75c4427f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:37:27 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-5b85adc8-cdbf-4b0d-a689-db0db65bc9b4 tempest-VolumesServicesTestJSON-509723664 None] Created volume successfully. Nov 06 14:37:27 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-102eea46-46bd-4bbf-97ee-bfde615cc867 tempest-VolumesServicesTestJSON-509723664 None] Acquiring lock "cinder-2b0063b3-cbac-499e-8d58-82081272d1bf-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:37:27 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-102eea46-46bd-4bbf-97ee-bfde615cc867 tempest-VolumesServicesTestJSON-509723664 None] Lock "cinder-2b0063b3-cbac-499e-8d58-82081272d1bf-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:37:27 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-102eea46-46bd-4bbf-97ee-bfde615cc867 tempest-VolumesServicesTestJSON-509723664 None] Acquiring lock "cinder-quobyte-2b0063b3-cbac-499e-8d58-82081272d1bf" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:37:27 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-102eea46-46bd-4bbf-97ee-bfde615cc867 tempest-VolumesServicesTestJSON-509723664 None] Lock "cinder-quobyte-2b0063b3-cbac-499e-8d58-82081272d1bf" acquired by "delete_volume" :: waited 0.016s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:37:27 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf465cf-f69b-46c7-b81e-35e5e97babe7]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:37:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-102eea46-46bd-4bbf-97ee-bfde615cc867 tempest-VolumesServicesTestJSON-509723664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2b0063b3-cbac-499e-8d58-82081272d1bf {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:27 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2b0063b3-cbac-499e-8d58-82081272d1bf Nov 06 14:37:27 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:27 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-102eea46-46bd-4bbf-97ee-bfde615cc867 tempest-VolumesServicesTestJSON-509723664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2b0063b3-cbac-499e-8d58-82081272d1bf" returned: 0 in 0.393s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-102eea46-46bd-4bbf-97ee-bfde615cc867 tempest-VolumesServicesTestJSON-509723664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2b0063b3-cbac-499e-8d58-82081272d1bf {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:28 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2b0063b3-cbac-499e-8d58-82081272d1bf Nov 06 14:37:28 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:28 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-102eea46-46bd-4bbf-97ee-bfde615cc867 tempest-VolumesServicesTestJSON-509723664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2b0063b3-cbac-499e-8d58-82081272d1bf" returned: 0 in 0.258s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-102eea46-46bd-4bbf-97ee-bfde615cc867 tempest-VolumesServicesTestJSON-509723664 None] Lock "cinder-quobyte-2b0063b3-cbac-499e-8d58-82081272d1bf" released by "delete_volume" :: held 0.703s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:37:28 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-102eea46-46bd-4bbf-97ee-bfde615cc867 tempest-VolumesServicesTestJSON-509723664 None] Created reservations ['8318d624-0760-4d25-9fff-cb55d4bc0007', '8237c36a-8cd7-4305-b670-a8c97359abe8', '947ceb9e-ed25-4157-a3f9-d84d80d7c03f', 'b4b9a0c2-ef23-4c73-b0e9-05ce0c8db048'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:37:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-102eea46-46bd-4bbf-97ee-bfde615cc867 tempest-VolumesServicesTestJSON-509723664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:37:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-102eea46-46bd-4bbf-97ee-bfde615cc867 tempest-VolumesServicesTestJSON-509723664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:37:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-102eea46-46bd-4bbf-97ee-bfde615cc867 tempest-VolumesServicesTestJSON-509723664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:37:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-102eea46-46bd-4bbf-97ee-bfde615cc867 tempest-VolumesServicesTestJSON-509723664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:37:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-102eea46-46bd-4bbf-97ee-bfde615cc867 tempest-VolumesServicesTestJSON-509723664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:37:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-102eea46-46bd-4bbf-97ee-bfde615cc867 tempest-VolumesServicesTestJSON-509723664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:28 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:37:28 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:28 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-102eea46-46bd-4bbf-97ee-bfde615cc867 tempest-VolumesServicesTestJSON-509723664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.270s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:28 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-102eea46-46bd-4bbf-97ee-bfde615cc867 tempest-VolumesServicesTestJSON-509723664 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:37:28 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-102eea46-46bd-4bbf-97ee-bfde615cc867 tempest-VolumesServicesTestJSON-509723664 None] Deleted volume successfully. Nov 06 14:37:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-102eea46-46bd-4bbf-97ee-bfde615cc867 tempest-VolumesServicesTestJSON-509723664 None] Lock "cinder-2b0063b3-cbac-499e-8d58-82081272d1bf-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:37:38 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=113,cinder:UPDATE=139,cinder:INSERT=37,cinder:DELETE=10 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:37:38 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=87,cinder:INSERT=28,cinder:UPDATE=123,cinder:DELETE=7 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:37:45 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:37:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Flow 'volume_create_manager' (e1c009ac-c4de-45b2-b8d0-ae6597f46135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:37:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b96a897-222c-4484-b116-068ae5c07358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b96a897-222c-4484-b116-068ae5c07358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-442003457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a3e1a1-7f84-4faa-86e4-3d701c7af437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='007685e184e94bc2af5ce1d320327558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:37:45Z,use_quota=True,user_id='f76ca6f008554063a15780076bf81d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5101c4b2-3610-4774-a449-2848116a5447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5101c4b2-3610-4774-a449-2848116a5447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60933d80-0ad5-4771-af14-4f0f8f711612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:45 devstack cinder-volume[86854]: DEBUG cinder.image.glance [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Creating Keystone auth plugin from conf {{(pid=86854) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 14:37:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60933d80-0ad5-4771-af14-4f0f8f711612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c7a3e1a1-7f84-4faa-86e4-3d701c7af437', 'volume_name': 'volume-c7a3e1a1-7f84-4faa-86e4-3d701c7af437', 'volume_size': 1, 'image_id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15767f46df214a0b8fce21735120de72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'created_at': datetime.datetime(2026, 11, 6, 13, 20, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 20, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0e99-e622-4342-8eb8-14122332c9ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84500b38-9f12-4dcd-980a-0d29008ad67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84500b38-9f12-4dcd-980a-0d29008ad67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df2bda37-3ae0-4daf-b2e1-8abef573726e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:45 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Volume c7a3e1a1-7f84-4faa-86e4-3d701c7af437: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c7a3e1a1-7f84-4faa-86e4-3d701c7af437', 'volume_size': 1, 'image_id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15767f46df214a0b8fce21735120de72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'created_at': datetime.datetime(2026, 11, 6, 13, 20, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 20, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0e99-e622-4342-8eb8-14122332c9ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 14:37:45 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Trying to clone c7a3e1a1-7f84-4faa-86e4-3d701c7af437 from image 918d0e99-e622-4342-8eb8-14122332c9ca at location (None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}]). {{(pid=86854) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 14:37:45 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_jd7qy0ocdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 14:37:45 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Image download 20.69 MB at 20.69 MB/s Nov 06 14:37:46 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[a296e70d-b98f-4ed9-9883-b5d0d5db6a3d]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:37:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_jd7qy0ocdevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:46 devstack sudo[99930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_jd7qy0ocdevstack@QuobyteHD Nov 06 14:37:46 devstack sudo[99930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:46 devstack sudo[99930]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_jd7qy0ocdevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:46 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Temporary image 918d0e99-e622-4342-8eb8-14122332c9ca is fetched for user f76ca6f008554063a15780076bf81d90. {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 14:37:46 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[e670b678-96e4-4e5e-9f66-5ebd9cf22180]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:37:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_jd7qy0ocdevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:46 devstack sudo[99935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_jd7qy0ocdevstack@QuobyteHD Nov 06 14:37:46 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:46 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_jd7qy0ocdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:37:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:37:46 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-442003457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a3e1a1-7f84-4faa-86e4-3d701c7af437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='007685e184e94bc2af5ce1d320327558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:37:45Z,use_quota=True,user_id='f76ca6f008554063a15780076bf81d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:37:46 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Creating volume c7a3e1a1-7f84-4faa-86e4-3d701c7af437 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:37:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:37:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:37:46 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:37:46 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:37:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:37:46 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:37:46 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:37:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c7a3e1a1-7f84-4faa-86e4-3d701c7af437 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:46 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c7a3e1a1-7f84-4faa-86e4-3d701c7af437 1073741824 Nov 06 14:37:46 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:47 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c7a3e1a1-7f84-4faa-86e4-3d701c7af437 1073741824" returned: 0 in 0.470s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c7a3e1a1-7f84-4faa-86e4-3d701c7af437 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:47 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c7a3e1a1-7f84-4faa-86e4-3d701c7af437 Nov 06 14:37:47 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:47 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c7a3e1a1-7f84-4faa-86e4-3d701c7af437" returned: 0 in 0.255s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:47 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:37:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:37:47 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Attempting download of 918d0e99-e622-4342-8eb8-14122332c9ca ((None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}])) to volume c7a3e1a1-7f84-4faa-86e4-3d701c7af437. {{(pid=86854) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 14:37:47 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e76b70-096e-4bfc-8b2f-64694d4fa405]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:37:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_200wipoo {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:47 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_200wipoo Nov 06 14:37:47 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:47 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_200wipoo" returned: 0 in 0.331s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_200wipoo {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:48 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_200wipoo Nov 06 14:37:48 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:48 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_200wipoo" returned: 1 in 0.325s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_200wipoo' failed. Not Retrying. {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 14:37:48 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[3588ebc4-1693-4435-b260-121eaea2f849]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:37:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_jd7qy0ocdevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:48 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_jd7qy0ocdevstack@QuobyteHD Nov 06 14:37:48 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:48 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_jd7qy0ocdevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:48 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] 918d0e99-e622-4342-8eb8-14122332c9ca was qcow2, converting to qcow2 {{(pid=86854) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 14:37:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_jd7qy0ocdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c7a3e1a1-7f84-4faa-86e4-3d701c7af437 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:48 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_jd7qy0ocdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c7a3e1a1-7f84-4faa-86e4-3d701c7af437 Nov 06 14:37:48 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:50 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_jd7qy0ocdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c7a3e1a1-7f84-4faa-86e4-3d701c7af437" returned: 0 in 1.904s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:50 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_jd7qy0ocdevstack@QuobyteHD, size 112.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c7a3e1a1-7f84-4faa-86e4-3d701c7af437 {{(pid=86854) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 14:37:50 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Converted 112.00 MB image at 58.76 MB/s Nov 06 14:37:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c7a3e1a1-7f84-4faa-86e4-3d701c7af437 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:50 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c7a3e1a1-7f84-4faa-86e4-3d701c7af437 1G Nov 06 14:37:50 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:50 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c7a3e1a1-7f84-4faa-86e4-3d701c7af437 1G" returned: 0 in 0.342s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:50 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Downloaded image 918d0e99-e622-4342-8eb8-14122332c9ca ((None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}])) to volume c7a3e1a1-7f84-4faa-86e4-3d701c7af437 successfully. {{(pid=86854) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 14:37:50 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Temporary image 918d0e99-e622-4342-8eb8-14122332c9ca for user f76ca6f008554063a15780076bf81d90 is deleted. {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 14:37:50 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Marking volume c7a3e1a1-7f84-4faa-86e4-3d701c7af437 as bootable. {{(pid=86854) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 14:37:50 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Copying metadata from image 918d0e99-e622-4342-8eb8-14122332c9ca to c7a3e1a1-7f84-4faa-86e4-3d701c7af437. {{(pid=86854) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 14:37:50 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Creating volume glance metadata for volume c7a3e1a1-7f84-4faa-86e4-3d701c7af437 backed by image 918d0e99-e622-4342-8eb8-14122332c9ca with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86854) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 14:37:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df2bda37-3ae0-4daf-b2e1-8abef573726e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7a3e1a1-7f84-4faa-86e4-3d701c7af437', 'volume_size': 1, 'image_id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15767f46df214a0b8fce21735120de72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'created_at': datetime.datetime(2026, 11, 6, 13, 20, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 20, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0e99-e622-4342-8eb8-14122332c9ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec0238e-c46a-4bbd-8dc0-21d21df542a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:51 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Volume volume-c7a3e1a1-7f84-4faa-86e4-3d701c7af437 (c7a3e1a1-7f84-4faa-86e4-3d701c7af437): created successfully Nov 06 14:37:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec0238e-c46a-4bbd-8dc0-21d21df542a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Flow 'volume_create_manager' (e1c009ac-c4de-45b2-b8d0-ae6597f46135) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:37:51 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-1119dbaf-7f0e-467b-8e12-c295d028faa4 tempest-VolumesImageMetadata-632228114 None] Created volume successfully. Nov 06 14:37:52 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-73f2cb4f-1b86-499e-9873-c09b9d97020e tempest-VolumesImageMetadata-632228114 None] Acquiring lock "cinder-c7a3e1a1-7f84-4faa-86e4-3d701c7af437-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:37:52 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-73f2cb4f-1b86-499e-9873-c09b9d97020e tempest-VolumesImageMetadata-632228114 None] Lock "cinder-c7a3e1a1-7f84-4faa-86e4-3d701c7af437-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:37:52 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-73f2cb4f-1b86-499e-9873-c09b9d97020e tempest-VolumesImageMetadata-632228114 None] Acquiring lock "cinder-quobyte-c7a3e1a1-7f84-4faa-86e4-3d701c7af437" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:37:52 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-73f2cb4f-1b86-499e-9873-c09b9d97020e tempest-VolumesImageMetadata-632228114 None] Lock "cinder-quobyte-c7a3e1a1-7f84-4faa-86e4-3d701c7af437" acquired by "delete_volume" :: waited 0.016s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:37:52 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5542e4a-c266-4d67-ac79-5731e8148800]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:37:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-73f2cb4f-1b86-499e-9873-c09b9d97020e tempest-VolumesImageMetadata-632228114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c7a3e1a1-7f84-4faa-86e4-3d701c7af437 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:52 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c7a3e1a1-7f84-4faa-86e4-3d701c7af437 Nov 06 14:37:52 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:52 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-73f2cb4f-1b86-499e-9873-c09b9d97020e tempest-VolumesImageMetadata-632228114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c7a3e1a1-7f84-4faa-86e4-3d701c7af437" returned: 0 in 0.412s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-73f2cb4f-1b86-499e-9873-c09b9d97020e tempest-VolumesImageMetadata-632228114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c7a3e1a1-7f84-4faa-86e4-3d701c7af437 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:52 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c7a3e1a1-7f84-4faa-86e4-3d701c7af437 Nov 06 14:37:52 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:52 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-73f2cb4f-1b86-499e-9873-c09b9d97020e tempest-VolumesImageMetadata-632228114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c7a3e1a1-7f84-4faa-86e4-3d701c7af437" returned: 0 in 0.310s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:52 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-73f2cb4f-1b86-499e-9873-c09b9d97020e tempest-VolumesImageMetadata-632228114 None] Lock "cinder-quobyte-c7a3e1a1-7f84-4faa-86e4-3d701c7af437" released by "delete_volume" :: held 0.796s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:37:53 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-73f2cb4f-1b86-499e-9873-c09b9d97020e tempest-VolumesImageMetadata-632228114 None] Created reservations ['8be054f4-6585-41ac-9fb3-98150c26ca39', '8bd14f0a-e5d3-4a18-b5ff-747e7b021a1b', '7836e401-c6f4-44b6-be57-56aa5543e49a', '491f80fb-f639-453e-b1fd-f73f7dfab4a6'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:37:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-73f2cb4f-1b86-499e-9873-c09b9d97020e tempest-VolumesImageMetadata-632228114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:37:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-73f2cb4f-1b86-499e-9873-c09b9d97020e tempest-VolumesImageMetadata-632228114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:37:53 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-73f2cb4f-1b86-499e-9873-c09b9d97020e tempest-VolumesImageMetadata-632228114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:37:53 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-73f2cb4f-1b86-499e-9873-c09b9d97020e tempest-VolumesImageMetadata-632228114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:37:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-73f2cb4f-1b86-499e-9873-c09b9d97020e tempest-VolumesImageMetadata-632228114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:37:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-73f2cb4f-1b86-499e-9873-c09b9d97020e tempest-VolumesImageMetadata-632228114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:53 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:37:53 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:53 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-73f2cb4f-1b86-499e-9873-c09b9d97020e tempest-VolumesImageMetadata-632228114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.271s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:53 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-73f2cb4f-1b86-499e-9873-c09b9d97020e tempest-VolumesImageMetadata-632228114 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:37:53 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-73f2cb4f-1b86-499e-9873-c09b9d97020e tempest-VolumesImageMetadata-632228114 None] Deleted volume successfully. Nov 06 14:37:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-73f2cb4f-1b86-499e-9873-c09b9d97020e tempest-VolumesImageMetadata-632228114 None] Lock "cinder-c7a3e1a1-7f84-4faa-86e4-3d701c7af437-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:37:58 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:37:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Flow 'volume_create_manager' (0a2d8359-a874-4162-9b69-7527a4d8dac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:37:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78086aaf-7586-4de7-b5e3-b6abd90c9eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78086aaf-7586-4de7-b5e3-b6abd90c9eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-11336528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=361a04ca-3de3-4ebc-92cf-b8f27d24f57e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877681d6b9c14d6c845239cc156cb21c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:37:58Z,use_quota=True,user_id='baa64ab64bc743098bd7c0ae6a6e930f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437a99ba-e85f-4c91-a744-ce7e0494aaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437a99ba-e85f-4c91-a744-ce7e0494aaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b98d818-b3c5-4bdd-a754-584dc1371f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b98d818-b3c5-4bdd-a754-584dc1371f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '361a04ca-3de3-4ebc-92cf-b8f27d24f57e', 'volume_name': 'volume-361a04ca-3de3-4ebc-92cf-b8f27d24f57e', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd9113bc-9de4-49c9-83fc-eb8cd485808b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd9113bc-9de4-49c9-83fc-eb8cd485808b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf9b362f-483a-411c-9cb0-8a8befbb79df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:58 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Volume 361a04ca-3de3-4ebc-92cf-b8f27d24f57e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-361a04ca-3de3-4ebc-92cf-b8f27d24f57e', 'volume_size': 1} Nov 06 14:37:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:37:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:37:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-11336528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=361a04ca-3de3-4ebc-92cf-b8f27d24f57e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877681d6b9c14d6c845239cc156cb21c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:37:58Z,use_quota=True,user_id='baa64ab64bc743098bd7c0ae6a6e930f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:37:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Creating volume 361a04ca-3de3-4ebc-92cf-b8f27d24f57e {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:37:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:37:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:37:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:37:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:37:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:37:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:37:58 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:37:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-361a04ca-3de3-4ebc-92cf-b8f27d24f57e 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:58 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-361a04ca-3de3-4ebc-92cf-b8f27d24f57e 1073741824 Nov 06 14:37:58 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:58 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-361a04ca-3de3-4ebc-92cf-b8f27d24f57e 1073741824" returned: 0 in 0.542s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-361a04ca-3de3-4ebc-92cf-b8f27d24f57e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:37:58 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-361a04ca-3de3-4ebc-92cf-b8f27d24f57e Nov 06 14:37:58 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:37:59 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Nov 06 14:37:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-361a04ca-3de3-4ebc-92cf-b8f27d24f57e" returned: 0 in 0.293s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:37:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:37:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:37:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf9b362f-483a-411c-9cb0-8a8befbb79df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-361a04ca-3de3-4ebc-92cf-b8f27d24f57e', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a8ba3a-1d3d-455d-a474-0745ffc6e8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:37:59 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Volume volume-361a04ca-3de3-4ebc-92cf-b8f27d24f57e (361a04ca-3de3-4ebc-92cf-b8f27d24f57e): created successfully Nov 06 14:37:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a8ba3a-1d3d-455d-a474-0745ffc6e8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:37:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Flow 'volume_create_manager' (0a2d8359-a874-4162-9b69-7527a4d8dac7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:37:59 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-e5b3365a-8d93-4831-b38f-111fd76242f8 tempest-VolumesActionsTest-1495623878 None] Created volume successfully. Nov 06 14:38:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-679abb57-1a85-4f7a-b603-b4fe2a84305e tempest-VolumesActionsTest-1495623878 None] Acquiring lock "cinder-361a04ca-3de3-4ebc-92cf-b8f27d24f57e" by "attach_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-679abb57-1a85-4f7a-b603-b4fe2a84305e tempest-VolumesActionsTest-1495623878 None] Lock "cinder-361a04ca-3de3-4ebc-92cf-b8f27d24f57e" acquired by "attach_volume" :: waited 0.022s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:00 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-679abb57-1a85-4f7a-b603-b4fe2a84305e tempest-VolumesActionsTest-1495623878 None] Attaching volume 361a04ca-3de3-4ebc-92cf-b8f27d24f57e to instance 7778b146-1eba-4f6c-be01-a65da23c95b2 at mountpoint /dev/vdb on host None. Nov 06 14:38:00 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-679abb57-1a85-4f7a-b603-b4fe2a84305e tempest-VolumesActionsTest-1495623878 None] Attach volume completed successfully. Nov 06 14:38:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-679abb57-1a85-4f7a-b603-b4fe2a84305e tempest-VolumesActionsTest-1495623878 None] Lock "cinder-361a04ca-3de3-4ebc-92cf-b8f27d24f57e" released by "attach_volume" :: held 0.108s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:01 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-4aba8138-682b-4209-929d-3f8d2a714a62 tempest-VolumesActionsTest-1600546862 None] Terminate volume connection completed successfully. Nov 06 14:38:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4aba8138-682b-4209-929d-3f8d2a714a62 tempest-VolumesActionsTest-1600546862 None] Acquiring lock "cinder-361a04ca-3de3-4ebc-92cf-b8f27d24f57e-detach_volume" by "detach_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4aba8138-682b-4209-929d-3f8d2a714a62 tempest-VolumesActionsTest-1600546862 None] Lock "cinder-361a04ca-3de3-4ebc-92cf-b8f27d24f57e-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:01 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-4aba8138-682b-4209-929d-3f8d2a714a62 tempest-VolumesActionsTest-1600546862 None] Detaching volume 361a04ca-3de3-4ebc-92cf-b8f27d24f57e from instance 7778b146-1eba-4f6c-be01-a65da23c95b2. Nov 06 14:38:01 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-4aba8138-682b-4209-929d-3f8d2a714a62 tempest-VolumesActionsTest-1600546862 None] Detach volume completed successfully. Nov 06 14:38:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4aba8138-682b-4209-929d-3f8d2a714a62 tempest-VolumesActionsTest-1600546862 None] Lock "cinder-361a04ca-3de3-4ebc-92cf-b8f27d24f57e-detach_volume" released by "detach_volume" :: held 0.085s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-0093a779-c58a-4301-a073-b7172b7cff3a tempest-VolumesActionsTest-1495623878 None] Acquiring lock "cinder-361a04ca-3de3-4ebc-92cf-b8f27d24f57e-detach_volume" by "detach_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-0093a779-c58a-4301-a073-b7172b7cff3a tempest-VolumesActionsTest-1495623878 None] Lock "cinder-361a04ca-3de3-4ebc-92cf-b8f27d24f57e-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:01 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-0093a779-c58a-4301-a073-b7172b7cff3a tempest-VolumesActionsTest-1495623878 None] Volume detach called, but volume not attached. Nov 06 14:38:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-0093a779-c58a-4301-a073-b7172b7cff3a tempest-VolumesActionsTest-1495623878 None] Lock "cinder-361a04ca-3de3-4ebc-92cf-b8f27d24f57e-detach_volume" released by "detach_volume" :: held 0.029s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-74872da6-8e54-49ea-bdb9-c40769cd3122 tempest-VolumesActionsTest-1495623878 None] Acquiring lock "cinder-361a04ca-3de3-4ebc-92cf-b8f27d24f57e-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-74872da6-8e54-49ea-bdb9-c40769cd3122 tempest-VolumesActionsTest-1495623878 None] Lock "cinder-361a04ca-3de3-4ebc-92cf-b8f27d24f57e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-74872da6-8e54-49ea-bdb9-c40769cd3122 tempest-VolumesActionsTest-1495623878 None] Acquiring lock "cinder-quobyte-361a04ca-3de3-4ebc-92cf-b8f27d24f57e" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-74872da6-8e54-49ea-bdb9-c40769cd3122 tempest-VolumesActionsTest-1495623878 None] Lock "cinder-quobyte-361a04ca-3de3-4ebc-92cf-b8f27d24f57e" acquired by "delete_volume" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:01 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[c440f6a4-6dad-42d5-acc4-4b786aa77ba5]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:38:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74872da6-8e54-49ea-bdb9-c40769cd3122 tempest-VolumesActionsTest-1495623878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-361a04ca-3de3-4ebc-92cf-b8f27d24f57e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:02 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-361a04ca-3de3-4ebc-92cf-b8f27d24f57e Nov 06 14:38:02 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:02 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74872da6-8e54-49ea-bdb9-c40769cd3122 tempest-VolumesActionsTest-1495623878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-361a04ca-3de3-4ebc-92cf-b8f27d24f57e" returned: 0 in 0.390s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74872da6-8e54-49ea-bdb9-c40769cd3122 tempest-VolumesActionsTest-1495623878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-361a04ca-3de3-4ebc-92cf-b8f27d24f57e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:02 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-361a04ca-3de3-4ebc-92cf-b8f27d24f57e Nov 06 14:38:02 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:02 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74872da6-8e54-49ea-bdb9-c40769cd3122 tempest-VolumesActionsTest-1495623878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-361a04ca-3de3-4ebc-92cf-b8f27d24f57e" returned: 0 in 0.313s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-74872da6-8e54-49ea-bdb9-c40769cd3122 tempest-VolumesActionsTest-1495623878 None] Lock "cinder-quobyte-361a04ca-3de3-4ebc-92cf-b8f27d24f57e" released by "delete_volume" :: held 0.760s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-74872da6-8e54-49ea-bdb9-c40769cd3122 tempest-VolumesActionsTest-1495623878 None] Created reservations ['08a971e0-f26c-4be9-a05a-3dceb6be3fa7', '27c0d822-eccb-4a1c-9504-aa80f7a842b1', '07b1da44-897e-4951-a311-89081db6459e', 'fff5122d-ffe9-45e1-8814-95d522ab956b'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Flow 'volume_create_manager' (11ef0983-fc05-4d66-8701-f1df55d25d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feaf804d-7b0b-4cfc-bac9-fbbcf746bfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feaf804d-7b0b-4cfc-bac9-fbbcf746bfd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-853452886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a5923a-41e8-4c43-9121-f1b7bd0a9b73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346b27c18f904930801b87440dedb68f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:38:03Z,use_quota=True,user_id='a0052c0564754e938588e0713ec3f471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d815fc9-6337-499c-a5a7-f7237c147cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d815fc9-6337-499c-a5a7-f7237c147cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ae5247-7952-4677-a39b-07ec10523800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ae5247-7952-4677-a39b-07ec10523800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0a5923a-41e8-4c43-9121-f1b7bd0a9b73', 'volume_name': 'volume-e0a5923a-41e8-4c43-9121-f1b7bd0a9b73', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a44aa36-c693-4884-a290-d448cfb23ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a44aa36-c693-4884-a290-d448cfb23ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f319d43-4235-4796-b6b6-e230fc55cb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:02 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Volume e0a5923a-41e8-4c43-9121-f1b7bd0a9b73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0a5923a-41e8-4c43-9121-f1b7bd0a9b73', 'volume_size': 1} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-853452886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a5923a-41e8-4c43-9121-f1b7bd0a9b73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346b27c18f904930801b87440dedb68f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:38:03Z,use_quota=True,user_id='a0052c0564754e938588e0713ec3f471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Creating volume e0a5923a-41e8-4c43-9121-f1b7bd0a9b73 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:38:02 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0a5923a-41e8-4c43-9121-f1b7bd0a9b73 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:02 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0a5923a-41e8-4c43-9121-f1b7bd0a9b73 1073741824 Nov 06 14:38:02 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-74872da6-8e54-49ea-bdb9-c40769cd3122 tempest-VolumesActionsTest-1495623878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-74872da6-8e54-49ea-bdb9-c40769cd3122 tempest-VolumesActionsTest-1495623878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-74872da6-8e54-49ea-bdb9-c40769cd3122 tempest-VolumesActionsTest-1495623878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-74872da6-8e54-49ea-bdb9-c40769cd3122 tempest-VolumesActionsTest-1495623878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-74872da6-8e54-49ea-bdb9-c40769cd3122 tempest-VolumesActionsTest-1495623878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74872da6-8e54-49ea-bdb9-c40769cd3122 tempest-VolumesActionsTest-1495623878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:02 devstack sudo[100102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:38:02 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:03 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74872da6-8e54-49ea-bdb9-c40769cd3122 tempest-VolumesActionsTest-1495623878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.480s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:03 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-74872da6-8e54-49ea-bdb9-c40769cd3122 tempest-VolumesActionsTest-1495623878 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:38:03 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-74872da6-8e54-49ea-bdb9-c40769cd3122 tempest-VolumesActionsTest-1495623878 None] Deleted volume successfully. Nov 06 14:38:03 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-74872da6-8e54-49ea-bdb9-c40769cd3122 tempest-VolumesActionsTest-1495623878 None] Lock "cinder-361a04ca-3de3-4ebc-92cf-b8f27d24f57e-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:03 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0a5923a-41e8-4c43-9121-f1b7bd0a9b73 1073741824" returned: 0 in 0.727s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0a5923a-41e8-4c43-9121-f1b7bd0a9b73 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:03 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0a5923a-41e8-4c43-9121-f1b7bd0a9b73 Nov 06 14:38:03 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:03 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0a5923a-41e8-4c43-9121-f1b7bd0a9b73" returned: 0 in 0.338s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:03 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:38:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:03 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f319d43-4235-4796-b6b6-e230fc55cb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0a5923a-41e8-4c43-9121-f1b7bd0a9b73', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:03 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34a273ab-0c82-446d-94e9-9e42c2dac8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:04 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Volume volume-e0a5923a-41e8-4c43-9121-f1b7bd0a9b73 (e0a5923a-41e8-4c43-9121-f1b7bd0a9b73): created successfully Nov 06 14:38:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34a273ab-0c82-446d-94e9-9e42c2dac8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Flow 'volume_create_manager' (11ef0983-fc05-4d66-8701-f1df55d25d0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:38:04 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-2f65d912-18e6-4f93-a671-5fc47e73fb56 tempest-VolumesTransfersV357Test-684990776 None] Created volume successfully. Nov 06 14:38:05 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-02b0a58c-ec03-4fc6-a0d4-975371d762eb tempest-VolumesTransfersV357Test-1581194872 None] Transfer volume completed successfully. Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-100e67aa-b16b-43d4-aa7d-49bef6495c57 tempest-VolumesTransfersV357Test-737949972 None] Acquiring lock "cinder-e0a5923a-41e8-4c43-9121-f1b7bd0a9b73-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-100e67aa-b16b-43d4-aa7d-49bef6495c57 tempest-VolumesTransfersV357Test-737949972 None] Lock "cinder-e0a5923a-41e8-4c43-9121-f1b7bd0a9b73-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-100e67aa-b16b-43d4-aa7d-49bef6495c57 tempest-VolumesTransfersV357Test-737949972 None] Acquiring lock "cinder-quobyte-e0a5923a-41e8-4c43-9121-f1b7bd0a9b73" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-100e67aa-b16b-43d4-aa7d-49bef6495c57 tempest-VolumesTransfersV357Test-737949972 None] Lock "cinder-quobyte-e0a5923a-41e8-4c43-9121-f1b7bd0a9b73" acquired by "delete_volume" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[812696e4-ff89-455f-94b1-d868e3b456c8]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-100e67aa-b16b-43d4-aa7d-49bef6495c57 tempest-VolumesTransfersV357Test-737949972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0a5923a-41e8-4c43-9121-f1b7bd0a9b73 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:38:06 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0a5923a-41e8-4c43-9121-f1b7bd0a9b73 Nov 06 14:38:06 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Flow 'volume_create_manager' (c1ccf1f3-81a4-40dc-b8fd-e964a23be0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b85f9170-6d25-46b1-ac63-cfab09b96732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b85f9170-6d25-46b1-ac63-cfab09b96732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-619574007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f033c2e-83bb-44f5-80bc-d6911c46a252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877681d6b9c14d6c845239cc156cb21c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:38:06Z,use_quota=True,user_id='baa64ab64bc743098bd7c0ae6a6e930f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (755ff3d4-68c2-4701-9d50-c536262a8e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (755ff3d4-68c2-4701-9d50-c536262a8e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b44c323f-840a-407c-9bb4-d95af5416464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b44c323f-840a-407c-9bb4-d95af5416464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f033c2e-83bb-44f5-80bc-d6911c46a252', 'volume_name': 'volume-7f033c2e-83bb-44f5-80bc-d6911c46a252', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e402c135-0802-49cd-abb8-01fdb5be0f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e402c135-0802-49cd-abb8-01fdb5be0f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1355d7ba-2316-411e-9431-88c434ca964b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:06 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Volume 7f033c2e-83bb-44f5-80bc-d6911c46a252: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f033c2e-83bb-44f5-80bc-d6911c46a252', 'volume_size': 1} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-619574007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f033c2e-83bb-44f5-80bc-d6911c46a252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877681d6b9c14d6c845239cc156cb21c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:38:06Z,use_quota=True,user_id='baa64ab64bc743098bd7c0ae6a6e930f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Creating volume 7f033c2e-83bb-44f5-80bc-d6911c46a252 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:38:06 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7f033c2e-83bb-44f5-80bc-d6911c46a252 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:06 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7f033c2e-83bb-44f5-80bc-d6911c46a252 1073741824 Nov 06 14:38:06 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:06 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-100e67aa-b16b-43d4-aa7d-49bef6495c57 tempest-VolumesTransfersV357Test-737949972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0a5923a-41e8-4c43-9121-f1b7bd0a9b73" returned: 0 in 0.372s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-100e67aa-b16b-43d4-aa7d-49bef6495c57 tempest-VolumesTransfersV357Test-737949972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0a5923a-41e8-4c43-9121-f1b7bd0a9b73 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:06 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0a5923a-41e8-4c43-9121-f1b7bd0a9b73 Nov 06 14:38:06 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:06 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:06 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-100e67aa-b16b-43d4-aa7d-49bef6495c57 tempest-VolumesTransfersV357Test-737949972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0a5923a-41e8-4c43-9121-f1b7bd0a9b73" returned: 0 in 0.240s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7f033c2e-83bb-44f5-80bc-d6911c46a252 1073741824" returned: 0 in 0.417s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-100e67aa-b16b-43d4-aa7d-49bef6495c57 tempest-VolumesTransfersV357Test-737949972 None] Lock "cinder-quobyte-e0a5923a-41e8-4c43-9121-f1b7bd0a9b73" released by "delete_volume" :: held 0.659s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7f033c2e-83bb-44f5-80bc-d6911c46a252 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:06 devstack sudo[100149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7f033c2e-83bb-44f5-80bc-d6911c46a252 Nov 06 14:38:06 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-100e67aa-b16b-43d4-aa7d-49bef6495c57 tempest-VolumesTransfersV357Test-737949972 None] Created reservations ['c8409266-a850-4988-b903-c8fa30842304', '00219948-acf7-42ae-8189-18aac11f7382', 'bfacde25-e068-4ef5-ab52-bf21dc23a9fa', '1346f965-f7f3-4f67-b4a4-a0b95470b639'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-100e67aa-b16b-43d4-aa7d-49bef6495c57 tempest-VolumesTransfersV357Test-737949972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-100e67aa-b16b-43d4-aa7d-49bef6495c57 tempest-VolumesTransfersV357Test-737949972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-100e67aa-b16b-43d4-aa7d-49bef6495c57 tempest-VolumesTransfersV357Test-737949972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-100e67aa-b16b-43d4-aa7d-49bef6495c57 tempest-VolumesTransfersV357Test-737949972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-100e67aa-b16b-43d4-aa7d-49bef6495c57 tempest-VolumesTransfersV357Test-737949972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-100e67aa-b16b-43d4-aa7d-49bef6495c57 tempest-VolumesTransfersV357Test-737949972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:06 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:38:06 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:07 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7f033c2e-83bb-44f5-80bc-d6911c46a252" returned: 0 in 0.253s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1355d7ba-2316-411e-9431-88c434ca964b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f033c2e-83bb-44f5-80bc-d6911c46a252', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3d7f5f-2c61-4ee5-8129-99efd7b7f305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:07 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Volume volume-7f033c2e-83bb-44f5-80bc-d6911c46a252 (7f033c2e-83bb-44f5-80bc-d6911c46a252): created successfully Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3d7f5f-2c61-4ee5-8129-99efd7b7f305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Flow 'volume_create_manager' (c1ccf1f3-81a4-40dc-b8fd-e964a23be0fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:38:07 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-475aa4c5-f428-4810-8840-0c2fb64a9e00 tempest-VolumesActionsTest-1495623878 None] Created volume successfully. Nov 06 14:38:07 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-100e67aa-b16b-43d4-aa7d-49bef6495c57 tempest-VolumesTransfersV357Test-737949972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.267s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-100e67aa-b16b-43d4-aa7d-49bef6495c57 tempest-VolumesTransfersV357Test-737949972 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:38:07 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-100e67aa-b16b-43d4-aa7d-49bef6495c57 tempest-VolumesTransfersV357Test-737949972 None] Deleted volume successfully. Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-100e67aa-b16b-43d4-aa7d-49bef6495c57 tempest-VolumesTransfersV357Test-737949972 None] Lock "cinder-e0a5923a-41e8-4c43-9121-f1b7bd0a9b73-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4f57154b-720b-45a4-9779-ef16c839f319 tempest-VolumesActionsTest-1600546862 None] Acquiring lock "cinder-7f033c2e-83bb-44f5-80bc-d6911c46a252-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4f57154b-720b-45a4-9779-ef16c839f319 tempest-VolumesActionsTest-1600546862 None] Lock "cinder-7f033c2e-83bb-44f5-80bc-d6911c46a252-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4f57154b-720b-45a4-9779-ef16c839f319 tempest-VolumesActionsTest-1600546862 None] Acquiring lock "cinder-quobyte-7f033c2e-83bb-44f5-80bc-d6911c46a252" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4f57154b-720b-45a4-9779-ef16c839f319 tempest-VolumesActionsTest-1600546862 None] Lock "cinder-quobyte-7f033c2e-83bb-44f5-80bc-d6911c46a252" acquired by "delete_volume" :: waited 0.021s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c57d1d1-c65e-42a2-8250-e73a333ed067]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4f57154b-720b-45a4-9779-ef16c839f319 tempest-VolumesActionsTest-1600546862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7f033c2e-83bb-44f5-80bc-d6911c46a252 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:07 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7f033c2e-83bb-44f5-80bc-d6911c46a252 Nov 06 14:38:07 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Flow 'volume_create_manager' (c8c0a5b0-36ac-45e2-98b3-fe75bf14db4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b094eb-35f9-4740-b140-22f767d1bace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b094eb-35f9-4740-b140-22f767d1bace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2054741544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=740096c6-6fdc-4d46-8efe-5ecf2c6af56e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346b27c18f904930801b87440dedb68f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:38:08Z,use_quota=True,user_id='a0052c0564754e938588e0713ec3f471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6636b159-a215-456d-b6e2-a11dc60e139f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6636b159-a215-456d-b6e2-a11dc60e139f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f015b30-9d43-40bb-98ce-92215b556c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f015b30-9d43-40bb-98ce-92215b556c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '740096c6-6fdc-4d46-8efe-5ecf2c6af56e', 'volume_name': 'volume-740096c6-6fdc-4d46-8efe-5ecf2c6af56e', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c143c5a-d342-4c38-aebb-5073fa3d72bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c143c5a-d342-4c38-aebb-5073fa3d72bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ccd942-89b3-408b-996c-bfd769c9819f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:07 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Volume 740096c6-6fdc-4d46-8efe-5ecf2c6af56e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-740096c6-6fdc-4d46-8efe-5ecf2c6af56e', 'volume_size': 1} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2054741544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=740096c6-6fdc-4d46-8efe-5ecf2c6af56e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346b27c18f904930801b87440dedb68f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:38:08Z,use_quota=True,user_id='a0052c0564754e938588e0713ec3f471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Creating volume 740096c6-6fdc-4d46-8efe-5ecf2c6af56e {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:38:07 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-740096c6-6fdc-4d46-8efe-5ecf2c6af56e 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:07 devstack sudo[100165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-740096c6-6fdc-4d46-8efe-5ecf2c6af56e 1073741824 Nov 06 14:38:07 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:07 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4f57154b-720b-45a4-9779-ef16c839f319 tempest-VolumesActionsTest-1600546862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7f033c2e-83bb-44f5-80bc-d6911c46a252" returned: 0 in 0.377s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4f57154b-720b-45a4-9779-ef16c839f319 tempest-VolumesActionsTest-1600546862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7f033c2e-83bb-44f5-80bc-d6911c46a252 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:07 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7f033c2e-83bb-44f5-80bc-d6911c46a252 Nov 06 14:38:07 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:08 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4f57154b-720b-45a4-9779-ef16c839f319 tempest-VolumesActionsTest-1600546862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7f033c2e-83bb-44f5-80bc-d6911c46a252" returned: 0 in 0.248s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:08 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4f57154b-720b-45a4-9779-ef16c839f319 tempest-VolumesActionsTest-1600546862 None] Lock "cinder-quobyte-7f033c2e-83bb-44f5-80bc-d6911c46a252" released by "delete_volume" :: held 0.674s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:08 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-4f57154b-720b-45a4-9779-ef16c839f319 tempest-VolumesActionsTest-1600546862 None] Created reservations ['a51155ca-9ac2-4fe0-bec4-3eb9096c3dfd', 'ae4d0393-aa78-47ac-8c12-c99924f47206', 'c2392005-d178-44c2-baa6-90ace19125f9', '7faf3f0b-3674-4956-801d-9800265e1a99'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:38:08 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-740096c6-6fdc-4d46-8efe-5ecf2c6af56e 1073741824" returned: 0 in 0.411s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-740096c6-6fdc-4d46-8efe-5ecf2c6af56e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:08 devstack sudo[100175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-740096c6-6fdc-4d46-8efe-5ecf2c6af56e Nov 06 14:38:08 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4f57154b-720b-45a4-9779-ef16c839f319 tempest-VolumesActionsTest-1600546862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4f57154b-720b-45a4-9779-ef16c839f319 tempest-VolumesActionsTest-1600546862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:08 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4f57154b-720b-45a4-9779-ef16c839f319 tempest-VolumesActionsTest-1600546862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:38:08 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4f57154b-720b-45a4-9779-ef16c839f319 tempest-VolumesActionsTest-1600546862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:38:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4f57154b-720b-45a4-9779-ef16c839f319 tempest-VolumesActionsTest-1600546862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4f57154b-720b-45a4-9779-ef16c839f319 tempest-VolumesActionsTest-1600546862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:08 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:38:08 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:08 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-740096c6-6fdc-4d46-8efe-5ecf2c6af56e" returned: 0 in 0.256s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:08 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:38:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ccd942-89b3-408b-996c-bfd769c9819f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-740096c6-6fdc-4d46-8efe-5ecf2c6af56e', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14792e1-edf6-49ec-b041-dd6eb201b104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:08 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:08 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Volume volume-740096c6-6fdc-4d46-8efe-5ecf2c6af56e (740096c6-6fdc-4d46-8efe-5ecf2c6af56e): created successfully Nov 06 14:38:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14792e1-edf6-49ec-b041-dd6eb201b104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Flow 'volume_create_manager' (c8c0a5b0-36ac-45e2-98b3-fe75bf14db4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:38:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4f57154b-720b-45a4-9779-ef16c839f319 tempest-VolumesActionsTest-1600546862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.279s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:08 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-4f57154b-720b-45a4-9779-ef16c839f319 tempest-VolumesActionsTest-1600546862 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:38:08 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-4f57154b-720b-45a4-9779-ef16c839f319 tempest-VolumesActionsTest-1600546862 None] Deleted volume successfully. Nov 06 14:38:08 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-e7b945ab-c9ad-4e00-8c42-76fa8a806012 tempest-VolumesTransfersV357Test-684990776 None] Created volume successfully. Nov 06 14:38:08 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4f57154b-720b-45a4-9779-ef16c839f319 tempest-VolumesActionsTest-1600546862 None] Lock "cinder-7f033c2e-83bb-44f5-80bc-d6911c46a252-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2d363b76-6877-4b5c-b6a5-b14152e3bb8d tempest-VolumesTransfersV357Test-737949972 None] Acquiring lock "cinder-740096c6-6fdc-4d46-8efe-5ecf2c6af56e-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2d363b76-6877-4b5c-b6a5-b14152e3bb8d tempest-VolumesTransfersV357Test-737949972 None] Lock "cinder-740096c6-6fdc-4d46-8efe-5ecf2c6af56e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2d363b76-6877-4b5c-b6a5-b14152e3bb8d tempest-VolumesTransfersV357Test-737949972 None] Acquiring lock "cinder-quobyte-740096c6-6fdc-4d46-8efe-5ecf2c6af56e" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2d363b76-6877-4b5c-b6a5-b14152e3bb8d tempest-VolumesTransfersV357Test-737949972 None] Lock "cinder-quobyte-740096c6-6fdc-4d46-8efe-5ecf2c6af56e" acquired by "delete_volume" :: waited 0.014s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b429646-3c3c-4fd7-be59-d47d42429110]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2d363b76-6877-4b5c-b6a5-b14152e3bb8d tempest-VolumesTransfersV357Test-737949972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-740096c6-6fdc-4d46-8efe-5ecf2c6af56e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Flow 'volume_create_manager' (3a2e77e0-17c9-4c53-ab98-234999912363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c568db90-1c13-4fa9-a3fc-356c1ab2a694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c568db90-1c13-4fa9-a3fc-356c1ab2a694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-680557251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=133ec794-3c31-41f5-b774-9e1d72c3a2bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877681d6b9c14d6c845239cc156cb21c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:38:09Z,use_quota=True,user_id='baa64ab64bc743098bd7c0ae6a6e930f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3e97a1-8ef5-47c7-aa34-56f7fc175396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3e97a1-8ef5-47c7-aa34-56f7fc175396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19757ab-beba-413b-b723-dc3832b7a16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19757ab-beba-413b-b723-dc3832b7a16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '133ec794-3c31-41f5-b774-9e1d72c3a2bd', 'volume_name': 'volume-133ec794-3c31-41f5-b774-9e1d72c3a2bd', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:09 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-740096c6-6fdc-4d46-8efe-5ecf2c6af56e Nov 06 14:38:09 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd24acf-417e-49ad-8b6e-0a265c39c901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd24acf-417e-49ad-8b6e-0a265c39c901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7bee5e4-dc2e-48b5-9f86-006cb7ee2bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:09 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Volume 133ec794-3c31-41f5-b774-9e1d72c3a2bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-133ec794-3c31-41f5-b774-9e1d72c3a2bd', 'volume_size': 1} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-680557251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=133ec794-3c31-41f5-b774-9e1d72c3a2bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877681d6b9c14d6c845239cc156cb21c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:38:09Z,use_quota=True,user_id='baa64ab64bc743098bd7c0ae6a6e930f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Creating volume 133ec794-3c31-41f5-b774-9e1d72c3a2bd {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:38:09 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-133ec794-3c31-41f5-b774-9e1d72c3a2bd 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:09 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-133ec794-3c31-41f5-b774-9e1d72c3a2bd 1073741824 Nov 06 14:38:09 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:09 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2d363b76-6877-4b5c-b6a5-b14152e3bb8d tempest-VolumesTransfersV357Test-737949972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-740096c6-6fdc-4d46-8efe-5ecf2c6af56e" returned: 0 in 0.376s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2d363b76-6877-4b5c-b6a5-b14152e3bb8d tempest-VolumesTransfersV357Test-737949972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-740096c6-6fdc-4d46-8efe-5ecf2c6af56e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:09 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-740096c6-6fdc-4d46-8efe-5ecf2c6af56e Nov 06 14:38:09 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:09 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-133ec794-3c31-41f5-b774-9e1d72c3a2bd 1073741824" returned: 0 in 0.413s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-133ec794-3c31-41f5-b774-9e1d72c3a2bd {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:09 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-133ec794-3c31-41f5-b774-9e1d72c3a2bd Nov 06 14:38:09 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:09 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2d363b76-6877-4b5c-b6a5-b14152e3bb8d tempest-VolumesTransfersV357Test-737949972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-740096c6-6fdc-4d46-8efe-5ecf2c6af56e" returned: 0 in 0.267s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2d363b76-6877-4b5c-b6a5-b14152e3bb8d tempest-VolumesTransfersV357Test-737949972 None] Lock "cinder-quobyte-740096c6-6fdc-4d46-8efe-5ecf2c6af56e" released by "delete_volume" :: held 0.691s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-2d363b76-6877-4b5c-b6a5-b14152e3bb8d tempest-VolumesTransfersV357Test-737949972 None] Created reservations ['edc88ceb-6c4a-4405-b5fc-8f38c27a17d6', '73c95cf6-25cf-4f5b-a73a-5033618a4e35', '1d3a8c51-c6b5-4368-96ae-f7764e0041dc', 'bc024c57-c02b-4869-b33e-c0ca5fd48b1e'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2d363b76-6877-4b5c-b6a5-b14152e3bb8d tempest-VolumesTransfersV357Test-737949972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2d363b76-6877-4b5c-b6a5-b14152e3bb8d tempest-VolumesTransfersV357Test-737949972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2d363b76-6877-4b5c-b6a5-b14152e3bb8d tempest-VolumesTransfersV357Test-737949972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2d363b76-6877-4b5c-b6a5-b14152e3bb8d tempest-VolumesTransfersV357Test-737949972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2d363b76-6877-4b5c-b6a5-b14152e3bb8d tempest-VolumesTransfersV357Test-737949972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2d363b76-6877-4b5c-b6a5-b14152e3bb8d tempest-VolumesTransfersV357Test-737949972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:10 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:38:10 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:10 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-133ec794-3c31-41f5-b774-9e1d72c3a2bd" returned: 0 in 0.257s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:10 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:38:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7bee5e4-dc2e-48b5-9f86-006cb7ee2bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-133ec794-3c31-41f5-b774-9e1d72c3a2bd', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0a01223-5df5-429e-bdd3-02444008bf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:10 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Volume volume-133ec794-3c31-41f5-b774-9e1d72c3a2bd (133ec794-3c31-41f5-b774-9e1d72c3a2bd): created successfully Nov 06 14:38:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0a01223-5df5-429e-bdd3-02444008bf5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Flow 'volume_create_manager' (3a2e77e0-17c9-4c53-ab98-234999912363) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:38:10 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-367a5457-d24b-40d4-af71-162504667523 tempest-VolumesActionsTest-1495623878 None] Created volume successfully. Nov 06 14:38:10 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2d363b76-6877-4b5c-b6a5-b14152e3bb8d tempest-VolumesTransfersV357Test-737949972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.267s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:10 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-2d363b76-6877-4b5c-b6a5-b14152e3bb8d tempest-VolumesTransfersV357Test-737949972 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:38:10 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-2d363b76-6877-4b5c-b6a5-b14152e3bb8d tempest-VolumesTransfersV357Test-737949972 None] Deleted volume successfully. Nov 06 14:38:10 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2d363b76-6877-4b5c-b6a5-b14152e3bb8d tempest-VolumesTransfersV357Test-737949972 None] Lock "cinder-740096c6-6fdc-4d46-8efe-5ecf2c6af56e-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:10 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-82c8eab0-0e6b-4e75-886e-9c5c51b41f33 tempest-VolumesActionsTest-1600546862 None] Acquiring lock "cinder-133ec794-3c31-41f5-b774-9e1d72c3a2bd-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:10 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-82c8eab0-0e6b-4e75-886e-9c5c51b41f33 tempest-VolumesActionsTest-1600546862 None] Lock "cinder-133ec794-3c31-41f5-b774-9e1d72c3a2bd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:10 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-82c8eab0-0e6b-4e75-886e-9c5c51b41f33 tempest-VolumesActionsTest-1600546862 None] Acquiring lock "cinder-quobyte-133ec794-3c31-41f5-b774-9e1d72c3a2bd" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:10 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-82c8eab0-0e6b-4e75-886e-9c5c51b41f33 tempest-VolumesActionsTest-1600546862 None] Lock "cinder-quobyte-133ec794-3c31-41f5-b774-9e1d72c3a2bd" acquired by "delete_volume" :: waited 0.018s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:10 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc83d4b-9edd-4ccc-b23a-799af11b0f55]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:38:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-82c8eab0-0e6b-4e75-886e-9c5c51b41f33 tempest-VolumesActionsTest-1600546862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-133ec794-3c31-41f5-b774-9e1d72c3a2bd {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:10 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-133ec794-3c31-41f5-b774-9e1d72c3a2bd Nov 06 14:38:10 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:10 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-82c8eab0-0e6b-4e75-886e-9c5c51b41f33 tempest-VolumesActionsTest-1600546862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-133ec794-3c31-41f5-b774-9e1d72c3a2bd" returned: 0 in 0.392s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-82c8eab0-0e6b-4e75-886e-9c5c51b41f33 tempest-VolumesActionsTest-1600546862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-133ec794-3c31-41f5-b774-9e1d72c3a2bd {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:10 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-133ec794-3c31-41f5-b774-9e1d72c3a2bd Nov 06 14:38:10 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:11 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-82c8eab0-0e6b-4e75-886e-9c5c51b41f33 tempest-VolumesActionsTest-1600546862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-133ec794-3c31-41f5-b774-9e1d72c3a2bd" returned: 0 in 0.247s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-82c8eab0-0e6b-4e75-886e-9c5c51b41f33 tempest-VolumesActionsTest-1600546862 None] Lock "cinder-quobyte-133ec794-3c31-41f5-b774-9e1d72c3a2bd" released by "delete_volume" :: held 0.685s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:11 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-82c8eab0-0e6b-4e75-886e-9c5c51b41f33 tempest-VolumesActionsTest-1600546862 None] Created reservations ['f7fdeee4-2294-43a5-b585-cd054f8b5e4e', '88b83137-973b-4d40-b67f-323ce34c5c06', '6857ca43-2eda-4f4c-a125-a2f0c4653dbd', '045e06b0-d758-437a-b32e-ea62f73f22e5'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:38:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-82c8eab0-0e6b-4e75-886e-9c5c51b41f33 tempest-VolumesActionsTest-1600546862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-82c8eab0-0e6b-4e75-886e-9c5c51b41f33 tempest-VolumesActionsTest-1600546862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:11 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-82c8eab0-0e6b-4e75-886e-9c5c51b41f33 tempest-VolumesActionsTest-1600546862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:38:11 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-82c8eab0-0e6b-4e75-886e-9c5c51b41f33 tempest-VolumesActionsTest-1600546862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:38:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-82c8eab0-0e6b-4e75-886e-9c5c51b41f33 tempest-VolumesActionsTest-1600546862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-82c8eab0-0e6b-4e75-886e-9c5c51b41f33 tempest-VolumesActionsTest-1600546862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:11 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:38:11 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:11 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-82c8eab0-0e6b-4e75-886e-9c5c51b41f33 tempest-VolumesActionsTest-1600546862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.262s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:11 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-82c8eab0-0e6b-4e75-886e-9c5c51b41f33 tempest-VolumesActionsTest-1600546862 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:38:11 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-82c8eab0-0e6b-4e75-886e-9c5c51b41f33 tempest-VolumesActionsTest-1600546862 None] Deleted volume successfully. Nov 06 14:38:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-82c8eab0-0e6b-4e75-886e-9c5c51b41f33 tempest-VolumesActionsTest-1600546862 None] Lock "cinder-133ec794-3c31-41f5-b774-9e1d72c3a2bd-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:12 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:38:12 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Flow 'volume_create_manager' (08604422-2758-4bc3-a193-f17d8db663c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:38:12 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5101e8e8-2c71-4b71-afb8-4ed5dee69001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:12 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5101e8e8-2c71-4b71-afb8-4ed5dee69001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1987255564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73aa0437-5cbf-42d2-a022-09832f2ffd96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877681d6b9c14d6c845239cc156cb21c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:38:12Z,use_quota=True,user_id='baa64ab64bc743098bd7c0ae6a6e930f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:12 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7dd5d00-ad81-4c92-8736-d36acb85adad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:12 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7dd5d00-ad81-4c92-8736-d36acb85adad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:12 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63943c6f-022e-469e-ada8-63131ad483d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:12 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63943c6f-022e-469e-ada8-63131ad483d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73aa0437-5cbf-42d2-a022-09832f2ffd96', 'volume_name': 'volume-73aa0437-5cbf-42d2-a022-09832f2ffd96', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:12 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea70deb0-d52f-4e5f-a3fb-85d1f94ab246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:12 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea70deb0-d52f-4e5f-a3fb-85d1f94ab246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:12 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f1298b-48b2-4ab4-a097-5246ad737c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:12 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Volume 73aa0437-5cbf-42d2-a022-09832f2ffd96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73aa0437-5cbf-42d2-a022-09832f2ffd96', 'volume_size': 1} Nov 06 14:38:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:12 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1987255564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73aa0437-5cbf-42d2-a022-09832f2ffd96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877681d6b9c14d6c845239cc156cb21c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:38:12Z,use_quota=True,user_id='baa64ab64bc743098bd7c0ae6a6e930f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:38:12 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Creating volume 73aa0437-5cbf-42d2-a022-09832f2ffd96 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:38:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:12 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:38:12 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:38:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:12 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:38:12 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:38:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-73aa0437-5cbf-42d2-a022-09832f2ffd96 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:12 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-73aa0437-5cbf-42d2-a022-09832f2ffd96 1073741824 Nov 06 14:38:12 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:12 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-73aa0437-5cbf-42d2-a022-09832f2ffd96 1073741824" returned: 0 in 0.448s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-73aa0437-5cbf-42d2-a022-09832f2ffd96 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:12 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-73aa0437-5cbf-42d2-a022-09832f2ffd96 Nov 06 14:38:12 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:13 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-73aa0437-5cbf-42d2-a022-09832f2ffd96" returned: 0 in 0.291s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:13 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:38:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f1298b-48b2-4ab4-a097-5246ad737c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73aa0437-5cbf-42d2-a022-09832f2ffd96', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2494058-611f-4d9e-8ad5-7b10c2c8958f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:13 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Volume volume-73aa0437-5cbf-42d2-a022-09832f2ffd96 (73aa0437-5cbf-42d2-a022-09832f2ffd96): created successfully Nov 06 14:38:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2494058-611f-4d9e-8ad5-7b10c2c8958f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Flow 'volume_create_manager' (08604422-2758-4bc3-a193-f17d8db663c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:38:13 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-676a85af-1b48-4fbc-8849-f86b128e8037 tempest-VolumesActionsTest-1495623878 None] Created volume successfully. Nov 06 14:38:13 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-202d8ddc-8e29-4afd-b9d8-730f5efd6dcc tempest-VolumesActionsTest-1600546862 None] Acquiring lock "cinder-73aa0437-5cbf-42d2-a022-09832f2ffd96-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:13 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-202d8ddc-8e29-4afd-b9d8-730f5efd6dcc tempest-VolumesActionsTest-1600546862 None] Lock "cinder-73aa0437-5cbf-42d2-a022-09832f2ffd96-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:13 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-202d8ddc-8e29-4afd-b9d8-730f5efd6dcc tempest-VolumesActionsTest-1600546862 None] Acquiring lock "cinder-quobyte-73aa0437-5cbf-42d2-a022-09832f2ffd96" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:13 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-202d8ddc-8e29-4afd-b9d8-730f5efd6dcc tempest-VolumesActionsTest-1600546862 None] Lock "cinder-quobyte-73aa0437-5cbf-42d2-a022-09832f2ffd96" acquired by "delete_volume" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:13 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e88d31-569d-48bf-b6cd-1096a7430cb9]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:38:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-202d8ddc-8e29-4afd-b9d8-730f5efd6dcc tempest-VolumesActionsTest-1600546862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-73aa0437-5cbf-42d2-a022-09832f2ffd96 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:13 devstack sudo[100261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-73aa0437-5cbf-42d2-a022-09832f2ffd96 Nov 06 14:38:13 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:13 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-202d8ddc-8e29-4afd-b9d8-730f5efd6dcc tempest-VolumesActionsTest-1600546862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-73aa0437-5cbf-42d2-a022-09832f2ffd96" returned: 0 in 0.391s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-202d8ddc-8e29-4afd-b9d8-730f5efd6dcc tempest-VolumesActionsTest-1600546862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-73aa0437-5cbf-42d2-a022-09832f2ffd96 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:13 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-73aa0437-5cbf-42d2-a022-09832f2ffd96 Nov 06 14:38:13 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:14 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-202d8ddc-8e29-4afd-b9d8-730f5efd6dcc tempest-VolumesActionsTest-1600546862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-73aa0437-5cbf-42d2-a022-09832f2ffd96" returned: 0 in 0.258s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:14 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-202d8ddc-8e29-4afd-b9d8-730f5efd6dcc tempest-VolumesActionsTest-1600546862 None] Lock "cinder-quobyte-73aa0437-5cbf-42d2-a022-09832f2ffd96" released by "delete_volume" :: held 0.716s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:14 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-202d8ddc-8e29-4afd-b9d8-730f5efd6dcc tempest-VolumesActionsTest-1600546862 None] Created reservations ['fd48f9cf-ddfa-465e-a5ba-200ec9c8b9ee', 'e24a34aa-d0c7-429f-9877-1df5205ec0ba', '019765ae-235b-4b24-847e-1383dc43bf96', '544c7c34-b2cb-44d6-b0c8-902ce346746c'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:38:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-202d8ddc-8e29-4afd-b9d8-730f5efd6dcc tempest-VolumesActionsTest-1600546862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-202d8ddc-8e29-4afd-b9d8-730f5efd6dcc tempest-VolumesActionsTest-1600546862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-202d8ddc-8e29-4afd-b9d8-730f5efd6dcc tempest-VolumesActionsTest-1600546862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:38:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-202d8ddc-8e29-4afd-b9d8-730f5efd6dcc tempest-VolumesActionsTest-1600546862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:38:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-202d8ddc-8e29-4afd-b9d8-730f5efd6dcc tempest-VolumesActionsTest-1600546862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-202d8ddc-8e29-4afd-b9d8-730f5efd6dcc tempest-VolumesActionsTest-1600546862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:14 devstack sudo[100269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:38:14 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:14 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-202d8ddc-8e29-4afd-b9d8-730f5efd6dcc tempest-VolumesActionsTest-1600546862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.273s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:14 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-202d8ddc-8e29-4afd-b9d8-730f5efd6dcc tempest-VolumesActionsTest-1600546862 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:38:14 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-202d8ddc-8e29-4afd-b9d8-730f5efd6dcc tempest-VolumesActionsTest-1600546862 None] Deleted volume successfully. Nov 06 14:38:14 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-202d8ddc-8e29-4afd-b9d8-730f5efd6dcc tempest-VolumesActionsTest-1600546862 None] Lock "cinder-73aa0437-5cbf-42d2-a022-09832f2ffd96-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Flow 'volume_create_manager' (80e8bc59-75f6-497e-915a-bf1a051045a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33ffd72e-1f92-4684-94bb-dd2f1c67f06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33ffd72e-1f92-4684-94bb-dd2f1c67f06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1605754635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c4446f-3d41-4ffb-babd-7920b67ac829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877681d6b9c14d6c845239cc156cb21c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:38:15Z,use_quota=True,user_id='baa64ab64bc743098bd7c0ae6a6e930f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd88730-ae18-449e-ad5c-ba1653e097ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd88730-ae18-449e-ad5c-ba1653e097ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6707b1ae-a277-4265-8e3c-45b7dfd79792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6707b1ae-a277-4265-8e3c-45b7dfd79792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98c4446f-3d41-4ffb-babd-7920b67ac829', 'volume_name': 'volume-98c4446f-3d41-4ffb-babd-7920b67ac829', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (228eae06-3320-4387-979a-ca02be4ab856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (228eae06-3320-4387-979a-ca02be4ab856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62403a6e-844f-498b-9791-27fa32222bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:15 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Volume 98c4446f-3d41-4ffb-babd-7920b67ac829: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98c4446f-3d41-4ffb-babd-7920b67ac829', 'volume_size': 1} Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1605754635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c4446f-3d41-4ffb-babd-7920b67ac829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877681d6b9c14d6c845239cc156cb21c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:38:15Z,use_quota=True,user_id='baa64ab64bc743098bd7c0ae6a6e930f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Creating volume 98c4446f-3d41-4ffb-babd-7920b67ac829 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:38:15 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-98c4446f-3d41-4ffb-babd-7920b67ac829 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:15 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-98c4446f-3d41-4ffb-babd-7920b67ac829 1073741824 Nov 06 14:38:15 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:15 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-98c4446f-3d41-4ffb-babd-7920b67ac829 1073741824" returned: 0 in 0.455s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-98c4446f-3d41-4ffb-babd-7920b67ac829 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:15 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-98c4446f-3d41-4ffb-babd-7920b67ac829 Nov 06 14:38:15 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:15 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-98c4446f-3d41-4ffb-babd-7920b67ac829" returned: 0 in 0.267s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62403a6e-844f-498b-9791-27fa32222bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98c4446f-3d41-4ffb-babd-7920b67ac829', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf70a24-84c5-43f0-b169-273c88431a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:15 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Volume volume-98c4446f-3d41-4ffb-babd-7920b67ac829 (98c4446f-3d41-4ffb-babd-7920b67ac829): created successfully Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf70a24-84c5-43f0-b169-273c88431a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Flow 'volume_create_manager' (80e8bc59-75f6-497e-915a-bf1a051045a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:38:15 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-309d376a-356b-4c88-b957-78e6f4888052 tempest-VolumesActionsTest-1495623878 None] Created volume successfully. Nov 06 14:38:16 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a6391fb4-bf6a-447f-8349-ce84574d1474 tempest-VolumesActionsTest-1600546862 None] Acquiring lock "cinder-98c4446f-3d41-4ffb-babd-7920b67ac829-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:16 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a6391fb4-bf6a-447f-8349-ce84574d1474 tempest-VolumesActionsTest-1600546862 None] Lock "cinder-98c4446f-3d41-4ffb-babd-7920b67ac829-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:16 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a6391fb4-bf6a-447f-8349-ce84574d1474 tempest-VolumesActionsTest-1600546862 None] Acquiring lock "cinder-quobyte-98c4446f-3d41-4ffb-babd-7920b67ac829" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:16 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a6391fb4-bf6a-447f-8349-ce84574d1474 tempest-VolumesActionsTest-1600546862 None] Lock "cinder-quobyte-98c4446f-3d41-4ffb-babd-7920b67ac829" acquired by "delete_volume" :: waited 0.020s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:16 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3862190-68b9-42a0-a081-37740e5fe4b3]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:38:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a6391fb4-bf6a-447f-8349-ce84574d1474 tempest-VolumesActionsTest-1600546862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-98c4446f-3d41-4ffb-babd-7920b67ac829 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:16 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-98c4446f-3d41-4ffb-babd-7920b67ac829 Nov 06 14:38:16 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:16 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a6391fb4-bf6a-447f-8349-ce84574d1474 tempest-VolumesActionsTest-1600546862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-98c4446f-3d41-4ffb-babd-7920b67ac829" returned: 0 in 0.393s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a6391fb4-bf6a-447f-8349-ce84574d1474 tempest-VolumesActionsTest-1600546862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-98c4446f-3d41-4ffb-babd-7920b67ac829 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:16 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-98c4446f-3d41-4ffb-babd-7920b67ac829 Nov 06 14:38:16 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:17 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a6391fb4-bf6a-447f-8349-ce84574d1474 tempest-VolumesActionsTest-1600546862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-98c4446f-3d41-4ffb-babd-7920b67ac829" returned: 0 in 0.276s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:17 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a6391fb4-bf6a-447f-8349-ce84574d1474 tempest-VolumesActionsTest-1600546862 None] Lock "cinder-quobyte-98c4446f-3d41-4ffb-babd-7920b67ac829" released by "delete_volume" :: held 0.744s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:17 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-a6391fb4-bf6a-447f-8349-ce84574d1474 tempest-VolumesActionsTest-1600546862 None] Created reservations ['6241e0a3-a371-42d1-9d88-42fe97846f53', '0b440cdb-ad48-4bf1-94f3-d7906a47b1a7', '6f617d72-f4b6-45cf-a6ed-7f00b1aeb178', 'cefe96e1-acc8-4ef4-8c08-7340d8ed7d53'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:38:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a6391fb4-bf6a-447f-8349-ce84574d1474 tempest-VolumesActionsTest-1600546862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a6391fb4-bf6a-447f-8349-ce84574d1474 tempest-VolumesActionsTest-1600546862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a6391fb4-bf6a-447f-8349-ce84574d1474 tempest-VolumesActionsTest-1600546862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:38:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a6391fb4-bf6a-447f-8349-ce84574d1474 tempest-VolumesActionsTest-1600546862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:38:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a6391fb4-bf6a-447f-8349-ce84574d1474 tempest-VolumesActionsTest-1600546862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a6391fb4-bf6a-447f-8349-ce84574d1474 tempest-VolumesActionsTest-1600546862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:17 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:38:17 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:17 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a6391fb4-bf6a-447f-8349-ce84574d1474 tempest-VolumesActionsTest-1600546862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.264s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:17 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-a6391fb4-bf6a-447f-8349-ce84574d1474 tempest-VolumesActionsTest-1600546862 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:38:17 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-a6391fb4-bf6a-447f-8349-ce84574d1474 tempest-VolumesActionsTest-1600546862 None] Deleted volume successfully. Nov 06 14:38:17 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a6391fb4-bf6a-447f-8349-ce84574d1474 tempest-VolumesActionsTest-1600546862 None] Lock "cinder-98c4446f-3d41-4ffb-babd-7920b67ac829-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:17 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:38:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Flow 'volume_create_manager' (11ecac50-a657-4fe5-8125-1512f56c262a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:38:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2abd75a4-b569-4a67-925e-ee6f3d02b1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2abd75a4-b569-4a67-925e-ee6f3d02b1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1865404353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=701de68f-1260-4f42-96de-c4bc72156640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877681d6b9c14d6c845239cc156cb21c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:38:18Z,use_quota=True,user_id='baa64ab64bc743098bd7c0ae6a6e930f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc46244-ccef-4e3f-af2f-9d287dc63b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc46244-ccef-4e3f-af2f-9d287dc63b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36264f47-62ad-4295-8858-5178806e82ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36264f47-62ad-4295-8858-5178806e82ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '701de68f-1260-4f42-96de-c4bc72156640', 'volume_name': 'volume-701de68f-1260-4f42-96de-c4bc72156640', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cad20a0-ca79-4ad4-baee-8ffa6c513e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:18 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cad20a0-ca79-4ad4-baee-8ffa6c513e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:18 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff00790a-7e84-4d61-be2f-d0a40f668a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:18 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Volume 701de68f-1260-4f42-96de-c4bc72156640: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-701de68f-1260-4f42-96de-c4bc72156640', 'volume_size': 1} Nov 06 14:38:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:18 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1865404353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=701de68f-1260-4f42-96de-c4bc72156640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877681d6b9c14d6c845239cc156cb21c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:38:18Z,use_quota=True,user_id='baa64ab64bc743098bd7c0ae6a6e930f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:38:18 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Creating volume 701de68f-1260-4f42-96de-c4bc72156640 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:38:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:18 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:38:18 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:38:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:18 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:38:18 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:38:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-701de68f-1260-4f42-96de-c4bc72156640 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:18 devstack sudo[100292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-701de68f-1260-4f42-96de-c4bc72156640 1073741824 Nov 06 14:38:18 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:18 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-701de68f-1260-4f42-96de-c4bc72156640 1073741824" returned: 0 in 0.459s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-701de68f-1260-4f42-96de-c4bc72156640 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:18 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-701de68f-1260-4f42-96de-c4bc72156640 Nov 06 14:38:18 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:18 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-701de68f-1260-4f42-96de-c4bc72156640" returned: 0 in 0.245s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:18 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:38:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:18 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff00790a-7e84-4d61-be2f-d0a40f668a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-701de68f-1260-4f42-96de-c4bc72156640', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:18 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7172cc76-eaa6-490c-9177-f95453e1b5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:18 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Volume volume-701de68f-1260-4f42-96de-c4bc72156640 (701de68f-1260-4f42-96de-c4bc72156640): created successfully Nov 06 14:38:18 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7172cc76-eaa6-490c-9177-f95453e1b5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:18 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Flow 'volume_create_manager' (11ecac50-a657-4fe5-8125-1512f56c262a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:38:18 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-40545e8d-2403-4cd9-aceb-4ae62b6b348f tempest-VolumesActionsTest-1495623878 None] Created volume successfully. Nov 06 14:38:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ba2e56bb-d4d7-4954-a498-fbe5a9d8591f tempest-VolumesActionsTest-1495623878 None] Acquiring lock "cinder-701de68f-1260-4f42-96de-c4bc72156640-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ba2e56bb-d4d7-4954-a498-fbe5a9d8591f tempest-VolumesActionsTest-1495623878 None] Lock "cinder-701de68f-1260-4f42-96de-c4bc72156640-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ba2e56bb-d4d7-4954-a498-fbe5a9d8591f tempest-VolumesActionsTest-1495623878 None] Acquiring lock "cinder-quobyte-701de68f-1260-4f42-96de-c4bc72156640" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ba2e56bb-d4d7-4954-a498-fbe5a9d8591f tempest-VolumesActionsTest-1495623878 None] Lock "cinder-quobyte-701de68f-1260-4f42-96de-c4bc72156640" acquired by "delete_volume" :: waited 0.016s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:19 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[99202fc7-70a7-4a42-a074-ac5681023834]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:38:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ba2e56bb-d4d7-4954-a498-fbe5a9d8591f tempest-VolumesActionsTest-1495623878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-701de68f-1260-4f42-96de-c4bc72156640 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:19 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-701de68f-1260-4f42-96de-c4bc72156640 Nov 06 14:38:19 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:20 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ba2e56bb-d4d7-4954-a498-fbe5a9d8591f tempest-VolumesActionsTest-1495623878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-701de68f-1260-4f42-96de-c4bc72156640" returned: 0 in 0.481s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ba2e56bb-d4d7-4954-a498-fbe5a9d8591f tempest-VolumesActionsTest-1495623878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-701de68f-1260-4f42-96de-c4bc72156640 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:20 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-701de68f-1260-4f42-96de-c4bc72156640 Nov 06 14:38:20 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:20 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ba2e56bb-d4d7-4954-a498-fbe5a9d8591f tempest-VolumesActionsTest-1495623878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-701de68f-1260-4f42-96de-c4bc72156640" returned: 0 in 0.276s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ba2e56bb-d4d7-4954-a498-fbe5a9d8591f tempest-VolumesActionsTest-1495623878 None] Lock "cinder-quobyte-701de68f-1260-4f42-96de-c4bc72156640" released by "delete_volume" :: held 0.802s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:20 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-ba2e56bb-d4d7-4954-a498-fbe5a9d8591f tempest-VolumesActionsTest-1495623878 None] Created reservations ['2d57f85a-5360-4586-929e-8c2fd915bda2', 'b1244453-bef0-4f0a-a26b-726720425134', 'a74c8568-cbf6-4b17-8ff3-212d1e379dc0', 'a38e4934-0c9c-495d-b39a-85418842669f'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:38:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ba2e56bb-d4d7-4954-a498-fbe5a9d8591f tempest-VolumesActionsTest-1495623878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ba2e56bb-d4d7-4954-a498-fbe5a9d8591f tempest-VolumesActionsTest-1495623878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ba2e56bb-d4d7-4954-a498-fbe5a9d8591f tempest-VolumesActionsTest-1495623878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:38:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ba2e56bb-d4d7-4954-a498-fbe5a9d8591f tempest-VolumesActionsTest-1495623878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:38:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ba2e56bb-d4d7-4954-a498-fbe5a9d8591f tempest-VolumesActionsTest-1495623878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ba2e56bb-d4d7-4954-a498-fbe5a9d8591f tempest-VolumesActionsTest-1495623878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:20 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:38:20 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:20 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ba2e56bb-d4d7-4954-a498-fbe5a9d8591f tempest-VolumesActionsTest-1495623878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.265s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:20 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-ba2e56bb-d4d7-4954-a498-fbe5a9d8591f tempest-VolumesActionsTest-1495623878 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:38:20 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-ba2e56bb-d4d7-4954-a498-fbe5a9d8591f tempest-VolumesActionsTest-1495623878 None] Deleted volume successfully. Nov 06 14:38:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ba2e56bb-d4d7-4954-a498-fbe5a9d8591f tempest-VolumesActionsTest-1495623878 None] Lock "cinder-701de68f-1260-4f42-96de-c4bc72156640-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:38:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:38:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:38:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:23 devstack sudo[100313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:38:23 devstack sudo[100313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:23 devstack sudo[100313]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.297s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:23 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:38:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager._thread_info {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:38:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread count: 28 {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 14:38:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread info: [<_MainThread(MainThread, started 130306900594816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 14:38:26 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:38:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Flow 'volume_create_manager' (5fc79559-4f37-473f-b228-0b37b340e59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:38:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f342b2c9-fb7e-4a42-92fb-29e3621048b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f342b2c9-fb7e-4a42-92fb-29e3621048b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1425319771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c44feb5-883c-4874-b76d-34786bfa1bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08752a02980c4fc09d0658cd557b4503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:38:27Z,use_quota=True,user_id='6def1605845b493f931cce8d62228fe1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06d458c-bf8b-47c5-b967-8ea005db7386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06d458c-bf8b-47c5-b967-8ea005db7386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acd40ae6-2ebd-4831-8104-f38c22660f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acd40ae6-2ebd-4831-8104-f38c22660f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c44feb5-883c-4874-b76d-34786bfa1bad', 'volume_name': 'volume-5c44feb5-883c-4874-b76d-34786bfa1bad', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb5feac0-4a91-4c8f-94af-7f5503bbb177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb5feac0-4a91-4c8f-94af-7f5503bbb177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282a509f-8f2c-4a16-8a0a-4f02aa465307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:26 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Volume 5c44feb5-883c-4874-b76d-34786bfa1bad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c44feb5-883c-4874-b76d-34786bfa1bad', 'volume_size': 1} Nov 06 14:38:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:26 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1425319771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c44feb5-883c-4874-b76d-34786bfa1bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08752a02980c4fc09d0658cd557b4503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:38:27Z,use_quota=True,user_id='6def1605845b493f931cce8d62228fe1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:38:26 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Creating volume 5c44feb5-883c-4874-b76d-34786bfa1bad {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:38:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:26 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:38:26 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:38:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:26 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:38:26 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:38:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:26 devstack sudo[100317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad 1073741824 Nov 06 14:38:26 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:27 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad 1073741824" returned: 0 in 0.458s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:27 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad Nov 06 14:38:27 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:27 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad" returned: 0 in 0.252s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:27 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:38:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282a509f-8f2c-4a16-8a0a-4f02aa465307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c44feb5-883c-4874-b76d-34786bfa1bad', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d93491a-6ae2-4ff5-b55f-278c7139df90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:27 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Volume volume-5c44feb5-883c-4874-b76d-34786bfa1bad (5c44feb5-883c-4874-b76d-34786bfa1bad): created successfully Nov 06 14:38:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d93491a-6ae2-4ff5-b55f-278c7139df90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Flow 'volume_create_manager' (5fc79559-4f37-473f-b228-0b37b340e59f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:38:27 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-7d15d5f6-18b5-4bb8-b04d-879707141761 tempest-VolumesActionsTest-114615455 None] Created volume successfully. Nov 06 14:38:35 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:38:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Flow 'volume_create_manager' (113d4c08-97ad-4e67-b175-81eca1f9c3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:38:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c4990b9-f087-4b56-af2f-67bf78f276ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9e27d59d-5fd8-4157-b412-15fe764f64eb tempest-VolumesActionsTest-114615455 None] Acquiring lock "cinder-5c44feb5-883c-4874-b76d-34786bfa1bad" by "attach_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c4990b9-f087-4b56-af2f-67bf78f276ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-329231500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=398d0474-eabd-4de7-a272-1c42561a532e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849fbe756b1c4e799895523078319491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:38:36Z,use_quota=True,user_id='3d1e49e97038464788e61b8928e66df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa7c5b4d-307e-4dad-b720-289775747f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa7c5b4d-307e-4dad-b720-289775747f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82ca01ca-55dd-42d2-9d95-2a907a18c3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82ca01ca-55dd-42d2-9d95-2a907a18c3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '398d0474-eabd-4de7-a272-1c42561a532e', 'volume_name': 'volume-398d0474-eabd-4de7-a272-1c42561a532e', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c244214-aac4-43fa-b067-11e6974bac71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c244214-aac4-43fa-b067-11e6974bac71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1024385e-51be-4818-b69d-78010dbc9006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:35 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Volume 398d0474-eabd-4de7-a272-1c42561a532e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-398d0474-eabd-4de7-a272-1c42561a532e', 'volume_size': 1} Nov 06 14:38:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-329231500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=398d0474-eabd-4de7-a272-1c42561a532e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849fbe756b1c4e799895523078319491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:38:36Z,use_quota=True,user_id='3d1e49e97038464788e61b8928e66df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:38:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Creating volume 398d0474-eabd-4de7-a272-1c42561a532e {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:38:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:38:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:38:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:38:35 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:38:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-398d0474-eabd-4de7-a272-1c42561a532e 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9e27d59d-5fd8-4157-b412-15fe764f64eb tempest-VolumesActionsTest-114615455 None] Lock "cinder-5c44feb5-883c-4874-b76d-34786bfa1bad" acquired by "attach_volume" :: waited 0.080s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:35 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-398d0474-eabd-4de7-a272-1c42561a532e 1073741824 Nov 06 14:38:35 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:36 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-9e27d59d-5fd8-4157-b412-15fe764f64eb tempest-VolumesActionsTest-114615455 None] Attaching volume 5c44feb5-883c-4874-b76d-34786bfa1bad to instance 3ab1435f-9ce8-4a81-97b7-8c36511f9d9f at mountpoint /dev/vdb on host None. Nov 06 14:38:36 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-9e27d59d-5fd8-4157-b412-15fe764f64eb tempest-VolumesActionsTest-114615455 None] Attach volume completed successfully. Nov 06 14:38:36 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9e27d59d-5fd8-4157-b412-15fe764f64eb tempest-VolumesActionsTest-114615455 None] Lock "cinder-5c44feb5-883c-4874-b76d-34786bfa1bad" released by "attach_volume" :: held 0.102s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:36 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6d3465c8-f3b1-485f-8238-4e45879a0226 tempest-VolumesActionsTest-114615455 None] Acquiring lock "cinder-5c44feb5-883c-4874-b76d-34786bfa1bad-detach_volume" by "detach_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:36 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6d3465c8-f3b1-485f-8238-4e45879a0226 tempest-VolumesActionsTest-114615455 None] Lock "cinder-5c44feb5-883c-4874-b76d-34786bfa1bad-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:36 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-6d3465c8-f3b1-485f-8238-4e45879a0226 tempest-VolumesActionsTest-114615455 None] Detaching volume 5c44feb5-883c-4874-b76d-34786bfa1bad from instance 3ab1435f-9ce8-4a81-97b7-8c36511f9d9f. Nov 06 14:38:36 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-6d3465c8-f3b1-485f-8238-4e45879a0226 tempest-VolumesActionsTest-114615455 None] Detach volume completed successfully. Nov 06 14:38:36 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6d3465c8-f3b1-485f-8238-4e45879a0226 tempest-VolumesActionsTest-114615455 None] Lock "cinder-5c44feb5-883c-4874-b76d-34786bfa1bad-detach_volume" released by "detach_volume" :: held 0.079s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:36 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-398d0474-eabd-4de7-a272-1c42561a532e 1073741824" returned: 0 in 0.577s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-398d0474-eabd-4de7-a272-1c42561a532e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:36 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-398d0474-eabd-4de7-a272-1c42561a532e Nov 06 14:38:36 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:36 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-398d0474-eabd-4de7-a272-1c42561a532e" returned: 0 in 0.301s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:38:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1024385e-51be-4818-b69d-78010dbc9006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-398d0474-eabd-4de7-a272-1c42561a532e', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a724962-4b94-4bbf-a950-9645ba4d424d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:36 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Volume volume-398d0474-eabd-4de7-a272-1c42561a532e (398d0474-eabd-4de7-a272-1c42561a532e): created successfully Nov 06 14:38:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a724962-4b94-4bbf-a950-9645ba4d424d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Flow 'volume_create_manager' (113d4c08-97ad-4e67-b175-81eca1f9c3ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:38:36 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-00792577-e154-4ac2-81bb-9e3ac3effd72 tempest-VolumesListAdminTestJSON-506346134 None] Created volume successfully. Nov 06 14:38:38 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:38:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Flow 'volume_create_manager' (4d72674c-4bd0-4121-8864-c7cce3f913e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:38:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e7d0b0-1039-40c1-8111-d167bb8ff7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:38 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:UPDATE=109,cinder:SELECT=95,cinder:INSERT=31,cinder:DELETE=10 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:38:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e7d0b0-1039-40c1-8111-d167bb8ff7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1578848457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce6d5c7-3682-4b3c-8fca-6f318ff49428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849fbe756b1c4e799895523078319491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:38:38Z,use_quota=True,user_id='3d1e49e97038464788e61b8928e66df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e28820-d2a3-489c-afb4-e5cedc032863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e28820-d2a3-489c-afb4-e5cedc032863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ed9d8e-1484-4b8c-b0f3-739733cd6fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ed9d8e-1484-4b8c-b0f3-739733cd6fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ce6d5c7-3682-4b3c-8fca-6f318ff49428', 'volume_name': 'volume-3ce6d5c7-3682-4b3c-8fca-6f318ff49428', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98d2d94f-275a-44e8-8492-325cf500e01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98d2d94f-275a-44e8-8492-325cf500e01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c555ae7-d512-4a37-b30e-5c93e26565bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:38 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Volume 3ce6d5c7-3682-4b3c-8fca-6f318ff49428: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ce6d5c7-3682-4b3c-8fca-6f318ff49428', 'volume_size': 1} Nov 06 14:38:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1578848457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce6d5c7-3682-4b3c-8fca-6f318ff49428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849fbe756b1c4e799895523078319491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:38:38Z,use_quota=True,user_id='3d1e49e97038464788e61b8928e66df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:38:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Creating volume 3ce6d5c7-3682-4b3c-8fca-6f318ff49428 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:38:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:38:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:38:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:38:38 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:38:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3ce6d5c7-3682-4b3c-8fca-6f318ff49428 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:38 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3ce6d5c7-3682-4b3c-8fca-6f318ff49428 1073741824 Nov 06 14:38:38 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:39 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3ce6d5c7-3682-4b3c-8fca-6f318ff49428 1073741824" returned: 0 in 0.456s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:39 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=86,cinder:INSERT=33,cinder:UPDATE=118,cinder:DELETE=10 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:38:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3ce6d5c7-3682-4b3c-8fca-6f318ff49428 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:39 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3ce6d5c7-3682-4b3c-8fca-6f318ff49428 Nov 06 14:38:39 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:39 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3ce6d5c7-3682-4b3c-8fca-6f318ff49428" returned: 0 in 0.269s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:39 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:38:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c555ae7-d512-4a37-b30e-5c93e26565bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ce6d5c7-3682-4b3c-8fca-6f318ff49428', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8cd7f62-18dd-4dc2-ab4f-80d26da93cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:39 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Volume volume-3ce6d5c7-3682-4b3c-8fca-6f318ff49428 (3ce6d5c7-3682-4b3c-8fca-6f318ff49428): created successfully Nov 06 14:38:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8cd7f62-18dd-4dc2-ab4f-80d26da93cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Flow 'volume_create_manager' (4d72674c-4bd0-4121-8864-c7cce3f913e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:38:39 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-ad6b8e69-e70f-46aa-bfc6-6075c0929dff tempest-VolumesListAdminTestJSON-506346134 None] Created volume successfully. Nov 06 14:38:41 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:38:41 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Flow 'volume_create_manager' (4ee94469-9313-4894-96e5-6bfe34daba45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:38:41 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb12eb8-8d03-46c1-98fb-e19cf305aed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:41 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb12eb8-8d03-46c1-98fb-e19cf305aed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1352504525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18ed3e4-1775-4707-8f19-378edeb0f5a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849fbe756b1c4e799895523078319491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:38:41Z,use_quota=True,user_id='3d1e49e97038464788e61b8928e66df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:41 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8afbc8d3-42ab-4ff9-bebc-4bb0720e7269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:41 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8afbc8d3-42ab-4ff9-bebc-4bb0720e7269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:41 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03fe50d3-a40c-4521-8641-ee7f85e6a177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:41 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03fe50d3-a40c-4521-8641-ee7f85e6a177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd18ed3e4-1775-4707-8f19-378edeb0f5a5', 'volume_name': 'volume-d18ed3e4-1775-4707-8f19-378edeb0f5a5', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:41 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd91cd2-daa5-4ff0-96ed-e29cffbb7d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:41 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd91cd2-daa5-4ff0-96ed-e29cffbb7d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:41 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41cfa3cd-5860-49e5-9d83-8eff9f802ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:41 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Volume d18ed3e4-1775-4707-8f19-378edeb0f5a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d18ed3e4-1775-4707-8f19-378edeb0f5a5', 'volume_size': 1} Nov 06 14:38:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:41 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1352504525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18ed3e4-1775-4707-8f19-378edeb0f5a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849fbe756b1c4e799895523078319491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:38:41Z,use_quota=True,user_id='3d1e49e97038464788e61b8928e66df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:38:41 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Creating volume d18ed3e4-1775-4707-8f19-378edeb0f5a5 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:38:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:41 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:38:41 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:38:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:41 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:38:41 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:38:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d18ed3e4-1775-4707-8f19-378edeb0f5a5 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:41 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d18ed3e4-1775-4707-8f19-378edeb0f5a5 1073741824 Nov 06 14:38:41 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:41 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d18ed3e4-1775-4707-8f19-378edeb0f5a5 1073741824" returned: 0 in 0.540s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d18ed3e4-1775-4707-8f19-378edeb0f5a5 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:41 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d18ed3e4-1775-4707-8f19-378edeb0f5a5 Nov 06 14:38:41 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:42 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d18ed3e4-1775-4707-8f19-378edeb0f5a5" returned: 0 in 0.331s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:42 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:38:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41cfa3cd-5860-49e5-9d83-8eff9f802ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d18ed3e4-1775-4707-8f19-378edeb0f5a5', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baae9893-f27e-4ae1-9842-673fbb4f414e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:42 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Volume volume-d18ed3e4-1775-4707-8f19-378edeb0f5a5 (d18ed3e4-1775-4707-8f19-378edeb0f5a5): created successfully Nov 06 14:38:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baae9893-f27e-4ae1-9842-673fbb4f414e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Flow 'volume_create_manager' (4ee94469-9313-4894-96e5-6bfe34daba45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:38:42 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-ac8813bd-a24f-4969-ac4c-171c73bc0d53 tempest-VolumesListAdminTestJSON-506346134 None] Created volume successfully. Nov 06 14:38:44 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:38:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Flow 'volume_create_manager' (8d1ad2fd-c0c7-48bd-9f7f-8711be3073d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:38:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b0371f1-4bc7-4779-8e04-9d0b41a16533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b0371f1-4bc7-4779-8e04-9d0b41a16533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b631da7-4f86-4da2-a3bf-72754dbd9b32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880156a3958b4074b1984f1e0a8ae243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:38:44Z,use_quota=True,user_id='9dd4e1760bb6499f90d517ea3e48b3ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08309acc-151d-4ae4-80d9-2755785078f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08309acc-151d-4ae4-80d9-2755785078f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865157d2-e355-4b86-a441-4524e8b27390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865157d2-e355-4b86-a441-4524e8b27390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b631da7-4f86-4da2-a3bf-72754dbd9b32', 'volume_name': 'volume-0b631da7-4f86-4da2-a3bf-72754dbd9b32', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de69af1c-0e5e-4147-9acc-f4a824e8c2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de69af1c-0e5e-4147-9acc-f4a824e8c2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a096afb-0221-43ba-9893-5cbf65fc97ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:44 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Volume 0b631da7-4f86-4da2-a3bf-72754dbd9b32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b631da7-4f86-4da2-a3bf-72754dbd9b32', 'volume_size': 1} Nov 06 14:38:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b631da7-4f86-4da2-a3bf-72754dbd9b32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880156a3958b4074b1984f1e0a8ae243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:38:44Z,use_quota=True,user_id='9dd4e1760bb6499f90d517ea3e48b3ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:38:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Creating volume 0b631da7-4f86-4da2-a3bf-72754dbd9b32 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:38:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:38:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:38:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:38:44 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:38:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0b631da7-4f86-4da2-a3bf-72754dbd9b32 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:44 devstack sudo[100551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0b631da7-4f86-4da2-a3bf-72754dbd9b32 1073741824 Nov 06 14:38:44 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:45 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0b631da7-4f86-4da2-a3bf-72754dbd9b32 1073741824" returned: 0 in 0.544s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0b631da7-4f86-4da2-a3bf-72754dbd9b32 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:45 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0b631da7-4f86-4da2-a3bf-72754dbd9b32 Nov 06 14:38:45 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:45 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0b631da7-4f86-4da2-a3bf-72754dbd9b32" returned: 0 in 0.313s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:45 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:38:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a096afb-0221-43ba-9893-5cbf65fc97ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b631da7-4f86-4da2-a3bf-72754dbd9b32', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7c0583-3539-44b6-865f-a4028dcb4566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:38:45 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Volume volume-0b631da7-4f86-4da2-a3bf-72754dbd9b32 (0b631da7-4f86-4da2-a3bf-72754dbd9b32): created successfully Nov 06 14:38:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7c0583-3539-44b6-865f-a4028dcb4566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:38:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Flow 'volume_create_manager' (8d1ad2fd-c0c7-48bd-9f7f-8711be3073d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:38:45 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-2e075c6b-d289-440a-84cd-ca84b6c2465a tempest-VolumesListAdminTestJSON-2019380312 None] Created volume successfully. Nov 06 14:38:46 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8f1003e6-65f0-49fa-804c-4c2ebd30f9e2 tempest-VolumesListAdminTestJSON-2019380312 None] Acquiring lock "cinder-0b631da7-4f86-4da2-a3bf-72754dbd9b32-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:46 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8f1003e6-65f0-49fa-804c-4c2ebd30f9e2 tempest-VolumesListAdminTestJSON-2019380312 None] Lock "cinder-0b631da7-4f86-4da2-a3bf-72754dbd9b32-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:46 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8f1003e6-65f0-49fa-804c-4c2ebd30f9e2 tempest-VolumesListAdminTestJSON-2019380312 None] Acquiring lock "cinder-quobyte-0b631da7-4f86-4da2-a3bf-72754dbd9b32" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:46 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8f1003e6-65f0-49fa-804c-4c2ebd30f9e2 tempest-VolumesListAdminTestJSON-2019380312 None] Lock "cinder-quobyte-0b631da7-4f86-4da2-a3bf-72754dbd9b32" acquired by "delete_volume" :: waited 0.022s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:46 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be905c2-9cda-49f1-af23-eb7fc984a0bb]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:38:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8f1003e6-65f0-49fa-804c-4c2ebd30f9e2 tempest-VolumesListAdminTestJSON-2019380312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0b631da7-4f86-4da2-a3bf-72754dbd9b32 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:46 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-25b5cc62-b1d9-44e9-b7f7-468a727810e0 tempest-VolumesListAdminTestJSON-506346134 None] Acquiring lock "cinder-d18ed3e4-1775-4707-8f19-378edeb0f5a5-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:46 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-25b5cc62-b1d9-44e9-b7f7-468a727810e0 tempest-VolumesListAdminTestJSON-506346134 None] Lock "cinder-d18ed3e4-1775-4707-8f19-378edeb0f5a5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:46 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-25b5cc62-b1d9-44e9-b7f7-468a727810e0 tempest-VolumesListAdminTestJSON-506346134 None] Acquiring lock "cinder-quobyte-d18ed3e4-1775-4707-8f19-378edeb0f5a5" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:46 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-25b5cc62-b1d9-44e9-b7f7-468a727810e0 tempest-VolumesListAdminTestJSON-506346134 None] Lock "cinder-quobyte-d18ed3e4-1775-4707-8f19-378edeb0f5a5" acquired by "delete_volume" :: waited 0.025s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:46 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0b631da7-4f86-4da2-a3bf-72754dbd9b32 Nov 06 14:38:46 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:46 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca19528-8236-4f03-aa50-6091cc56e198]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:38:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25b5cc62-b1d9-44e9-b7f7-468a727810e0 tempest-VolumesListAdminTestJSON-506346134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d18ed3e4-1775-4707-8f19-378edeb0f5a5 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:46 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d18ed3e4-1775-4707-8f19-378edeb0f5a5 Nov 06 14:38:46 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:46 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c61a47b0-a003-4cab-9855-946e0d3a7f7a tempest-VolumesActionsTest-114615455 None] Acquiring lock "cinder-5c44feb5-883c-4874-b76d-34786bfa1bad" by "attach_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:46 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c61a47b0-a003-4cab-9855-946e0d3a7f7a tempest-VolumesActionsTest-114615455 None] Lock "cinder-5c44feb5-883c-4874-b76d-34786bfa1bad" acquired by "attach_volume" :: waited 0.028s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:47 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-c61a47b0-a003-4cab-9855-946e0d3a7f7a tempest-VolumesActionsTest-114615455 None] Attaching volume 5c44feb5-883c-4874-b76d-34786bfa1bad to instance 25057ce2-357d-46d7-a9fc-fa3aaaffec23 at mountpoint /dev/vdb on host None. Nov 06 14:38:47 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:47 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-c61a47b0-a003-4cab-9855-946e0d3a7f7a tempest-VolumesActionsTest-114615455 None] Attach volume completed successfully. Nov 06 14:38:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8f1003e6-65f0-49fa-804c-4c2ebd30f9e2 tempest-VolumesListAdminTestJSON-2019380312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0b631da7-4f86-4da2-a3bf-72754dbd9b32" returned: 0 in 0.547s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8f1003e6-65f0-49fa-804c-4c2ebd30f9e2 tempest-VolumesListAdminTestJSON-2019380312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0b631da7-4f86-4da2-a3bf-72754dbd9b32 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:47 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c61a47b0-a003-4cab-9855-946e0d3a7f7a tempest-VolumesActionsTest-114615455 None] Lock "cinder-5c44feb5-883c-4874-b76d-34786bfa1bad" released by "attach_volume" :: held 0.200s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:47 devstack sudo[100577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0b631da7-4f86-4da2-a3bf-72754dbd9b32 Nov 06 14:38:47 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:47 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25b5cc62-b1d9-44e9-b7f7-468a727810e0 tempest-VolumesListAdminTestJSON-506346134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d18ed3e4-1775-4707-8f19-378edeb0f5a5" returned: 0 in 0.467s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25b5cc62-b1d9-44e9-b7f7-468a727810e0 tempest-VolumesListAdminTestJSON-506346134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d18ed3e4-1775-4707-8f19-378edeb0f5a5 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:47 devstack sudo[100580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d18ed3e4-1775-4707-8f19-378edeb0f5a5 Nov 06 14:38:47 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:47 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8f1003e6-65f0-49fa-804c-4c2ebd30f9e2 tempest-VolumesListAdminTestJSON-2019380312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0b631da7-4f86-4da2-a3bf-72754dbd9b32" returned: 0 in 0.342s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:47 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8f1003e6-65f0-49fa-804c-4c2ebd30f9e2 tempest-VolumesListAdminTestJSON-2019380312 None] Lock "cinder-quobyte-0b631da7-4f86-4da2-a3bf-72754dbd9b32" released by "delete_volume" :: held 0.956s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:47 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-8f1003e6-65f0-49fa-804c-4c2ebd30f9e2 tempest-VolumesListAdminTestJSON-2019380312 None] Created reservations ['204f2a4e-7b63-494a-a32f-4e02daa09280', '715983ad-b2d5-454a-b8ef-a5936783937d', '4542ecdb-2aab-4add-968e-f8c9cb84eabc', 'a2bf6e4e-9ba9-41b9-9bd6-bdfed1542494'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:38:47 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25b5cc62-b1d9-44e9-b7f7-468a727810e0 tempest-VolumesListAdminTestJSON-506346134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d18ed3e4-1775-4707-8f19-378edeb0f5a5" returned: 0 in 0.328s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:47 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c1971470-d402-4817-8433-6692620b8d4f tempest-VolumesActionsTest-114615455 None] Acquiring lock "cinder-5c44feb5-883c-4874-b76d-34786bfa1bad-detach_volume" by "detach_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:47 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-25b5cc62-b1d9-44e9-b7f7-468a727810e0 tempest-VolumesListAdminTestJSON-506346134 None] Lock "cinder-quobyte-d18ed3e4-1775-4707-8f19-378edeb0f5a5" released by "delete_volume" :: held 0.863s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:47 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c1971470-d402-4817-8433-6692620b8d4f tempest-VolumesActionsTest-114615455 None] Lock "cinder-5c44feb5-883c-4874-b76d-34786bfa1bad-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:47 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-c1971470-d402-4817-8433-6692620b8d4f tempest-VolumesActionsTest-114615455 None] Detaching volume 5c44feb5-883c-4874-b76d-34786bfa1bad from instance 25057ce2-357d-46d7-a9fc-fa3aaaffec23. Nov 06 14:38:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8f1003e6-65f0-49fa-804c-4c2ebd30f9e2 tempest-VolumesListAdminTestJSON-2019380312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8f1003e6-65f0-49fa-804c-4c2ebd30f9e2 tempest-VolumesListAdminTestJSON-2019380312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:47 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8f1003e6-65f0-49fa-804c-4c2ebd30f9e2 tempest-VolumesListAdminTestJSON-2019380312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:38:47 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8f1003e6-65f0-49fa-804c-4c2ebd30f9e2 tempest-VolumesListAdminTestJSON-2019380312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:38:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8f1003e6-65f0-49fa-804c-4c2ebd30f9e2 tempest-VolumesListAdminTestJSON-2019380312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8f1003e6-65f0-49fa-804c-4c2ebd30f9e2 tempest-VolumesListAdminTestJSON-2019380312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:47 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-25b5cc62-b1d9-44e9-b7f7-468a727810e0 tempest-VolumesListAdminTestJSON-506346134 None] Created reservations ['5ddb3c9d-fd0f-486b-9f97-3b2123afa45d', '5f0aef3c-a2b8-4968-88d5-11fb2b4327da', 'f763054a-468d-4ff0-9ed9-e63c7c436a55', 'b715ebcf-58d0-4325-88cf-f66ca726c8bf'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:38:47 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-c1971470-d402-4817-8433-6692620b8d4f tempest-VolumesActionsTest-114615455 None] Detach volume completed successfully. Nov 06 14:38:47 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:38:47 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:47 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c1971470-d402-4817-8433-6692620b8d4f tempest-VolumesActionsTest-114615455 None] Lock "cinder-5c44feb5-883c-4874-b76d-34786bfa1bad-detach_volume" released by "detach_volume" :: held 0.138s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-25b5cc62-b1d9-44e9-b7f7-468a727810e0 tempest-VolumesListAdminTestJSON-506346134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-25b5cc62-b1d9-44e9-b7f7-468a727810e0 tempest-VolumesListAdminTestJSON-506346134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:47 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-25b5cc62-b1d9-44e9-b7f7-468a727810e0 tempest-VolumesListAdminTestJSON-506346134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:38:47 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-25b5cc62-b1d9-44e9-b7f7-468a727810e0 tempest-VolumesListAdminTestJSON-506346134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:38:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-25b5cc62-b1d9-44e9-b7f7-468a727810e0 tempest-VolumesListAdminTestJSON-506346134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25b5cc62-b1d9-44e9-b7f7-468a727810e0 tempest-VolumesListAdminTestJSON-506346134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:47 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:38:47 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:48 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8f1003e6-65f0-49fa-804c-4c2ebd30f9e2 tempest-VolumesListAdminTestJSON-2019380312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.365s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:48 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-8f1003e6-65f0-49fa-804c-4c2ebd30f9e2 tempest-VolumesListAdminTestJSON-2019380312 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:38:48 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-8f1003e6-65f0-49fa-804c-4c2ebd30f9e2 tempest-VolumesListAdminTestJSON-2019380312 None] Deleted volume successfully. Nov 06 14:38:48 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8f1003e6-65f0-49fa-804c-4c2ebd30f9e2 tempest-VolumesListAdminTestJSON-2019380312 None] Lock "cinder-0b631da7-4f86-4da2-a3bf-72754dbd9b32-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:48 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25b5cc62-b1d9-44e9-b7f7-468a727810e0 tempest-VolumesListAdminTestJSON-506346134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.340s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:48 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-25b5cc62-b1d9-44e9-b7f7-468a727810e0 tempest-VolumesListAdminTestJSON-506346134 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:38:48 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-25b5cc62-b1d9-44e9-b7f7-468a727810e0 tempest-VolumesListAdminTestJSON-506346134 None] Deleted volume successfully. Nov 06 14:38:48 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-25b5cc62-b1d9-44e9-b7f7-468a727810e0 tempest-VolumesListAdminTestJSON-506346134 None] Lock "cinder-d18ed3e4-1775-4707-8f19-378edeb0f5a5-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:48 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2475bfdf-82f0-4b78-ae65-e7ead46b78ec tempest-VolumesListAdminTestJSON-506346134 None] Acquiring lock "cinder-3ce6d5c7-3682-4b3c-8fca-6f318ff49428-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:48 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2475bfdf-82f0-4b78-ae65-e7ead46b78ec tempest-VolumesListAdminTestJSON-506346134 None] Lock "cinder-3ce6d5c7-3682-4b3c-8fca-6f318ff49428-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:49 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2475bfdf-82f0-4b78-ae65-e7ead46b78ec tempest-VolumesListAdminTestJSON-506346134 None] Acquiring lock "cinder-quobyte-3ce6d5c7-3682-4b3c-8fca-6f318ff49428" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:49 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2475bfdf-82f0-4b78-ae65-e7ead46b78ec tempest-VolumesListAdminTestJSON-506346134 None] Lock "cinder-quobyte-3ce6d5c7-3682-4b3c-8fca-6f318ff49428" acquired by "delete_volume" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:49 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[63593899-0791-4362-9079-4547a2ba1fa9]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:38:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2475bfdf-82f0-4b78-ae65-e7ead46b78ec tempest-VolumesListAdminTestJSON-506346134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3ce6d5c7-3682-4b3c-8fca-6f318ff49428 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:49 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3ce6d5c7-3682-4b3c-8fca-6f318ff49428 Nov 06 14:38:49 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:49 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2475bfdf-82f0-4b78-ae65-e7ead46b78ec tempest-VolumesListAdminTestJSON-506346134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3ce6d5c7-3682-4b3c-8fca-6f318ff49428" returned: 0 in 0.452s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2475bfdf-82f0-4b78-ae65-e7ead46b78ec tempest-VolumesListAdminTestJSON-506346134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3ce6d5c7-3682-4b3c-8fca-6f318ff49428 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:49 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3ce6d5c7-3682-4b3c-8fca-6f318ff49428 Nov 06 14:38:49 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:49 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2475bfdf-82f0-4b78-ae65-e7ead46b78ec tempest-VolumesListAdminTestJSON-506346134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3ce6d5c7-3682-4b3c-8fca-6f318ff49428" returned: 0 in 0.258s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:49 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2475bfdf-82f0-4b78-ae65-e7ead46b78ec tempest-VolumesListAdminTestJSON-506346134 None] Lock "cinder-quobyte-3ce6d5c7-3682-4b3c-8fca-6f318ff49428" released by "delete_volume" :: held 0.762s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:49 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-2475bfdf-82f0-4b78-ae65-e7ead46b78ec tempest-VolumesListAdminTestJSON-506346134 None] Created reservations ['0eb1f70d-b400-4187-9cfe-4ef431705452', '4921000e-52de-40c8-902c-9abada774e2d', 'e2ee3669-b430-4960-9e6c-59ab3a30afe7', '7a0d8f11-e541-4f53-b1b2-972091562c0a'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:38:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2475bfdf-82f0-4b78-ae65-e7ead46b78ec tempest-VolumesListAdminTestJSON-506346134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2475bfdf-82f0-4b78-ae65-e7ead46b78ec tempest-VolumesListAdminTestJSON-506346134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:49 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2475bfdf-82f0-4b78-ae65-e7ead46b78ec tempest-VolumesListAdminTestJSON-506346134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:38:49 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2475bfdf-82f0-4b78-ae65-e7ead46b78ec tempest-VolumesListAdminTestJSON-506346134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:38:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2475bfdf-82f0-4b78-ae65-e7ead46b78ec tempest-VolumesListAdminTestJSON-506346134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2475bfdf-82f0-4b78-ae65-e7ead46b78ec tempest-VolumesListAdminTestJSON-506346134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:49 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:38:49 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:50 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2475bfdf-82f0-4b78-ae65-e7ead46b78ec tempest-VolumesListAdminTestJSON-506346134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.255s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:50 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-2475bfdf-82f0-4b78-ae65-e7ead46b78ec tempest-VolumesListAdminTestJSON-506346134 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:38:50 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-2475bfdf-82f0-4b78-ae65-e7ead46b78ec tempest-VolumesListAdminTestJSON-506346134 None] Deleted volume successfully. Nov 06 14:38:50 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-5eb824a7-de19-4b6f-ae27-7da48653efbb tempest-VolumesListAdminTestJSON-506346134 None] Acquiring lock "cinder-398d0474-eabd-4de7-a272-1c42561a532e-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:50 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2475bfdf-82f0-4b78-ae65-e7ead46b78ec tempest-VolumesListAdminTestJSON-506346134 None] Lock "cinder-3ce6d5c7-3682-4b3c-8fca-6f318ff49428-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:50 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-5eb824a7-de19-4b6f-ae27-7da48653efbb tempest-VolumesListAdminTestJSON-506346134 None] Lock "cinder-398d0474-eabd-4de7-a272-1c42561a532e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:50 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-5eb824a7-de19-4b6f-ae27-7da48653efbb tempest-VolumesListAdminTestJSON-506346134 None] Acquiring lock "cinder-quobyte-398d0474-eabd-4de7-a272-1c42561a532e" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:38:50 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-5eb824a7-de19-4b6f-ae27-7da48653efbb tempest-VolumesListAdminTestJSON-506346134 None] Lock "cinder-quobyte-398d0474-eabd-4de7-a272-1c42561a532e" acquired by "delete_volume" :: waited 0.013s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:38:50 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a604f11-6153-427e-8daa-f4279a8c6830]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:38:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5eb824a7-de19-4b6f-ae27-7da48653efbb tempest-VolumesListAdminTestJSON-506346134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-398d0474-eabd-4de7-a272-1c42561a532e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:50 devstack sudo[100627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-398d0474-eabd-4de7-a272-1c42561a532e Nov 06 14:38:50 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:50 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5eb824a7-de19-4b6f-ae27-7da48653efbb tempest-VolumesListAdminTestJSON-506346134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-398d0474-eabd-4de7-a272-1c42561a532e" returned: 0 in 0.375s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5eb824a7-de19-4b6f-ae27-7da48653efbb tempest-VolumesListAdminTestJSON-506346134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-398d0474-eabd-4de7-a272-1c42561a532e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:50 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-398d0474-eabd-4de7-a272-1c42561a532e Nov 06 14:38:50 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:50 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5eb824a7-de19-4b6f-ae27-7da48653efbb tempest-VolumesListAdminTestJSON-506346134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-398d0474-eabd-4de7-a272-1c42561a532e" returned: 0 in 0.255s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:50 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-5eb824a7-de19-4b6f-ae27-7da48653efbb tempest-VolumesListAdminTestJSON-506346134 None] Lock "cinder-quobyte-398d0474-eabd-4de7-a272-1c42561a532e" released by "delete_volume" :: held 0.677s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:51 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-5eb824a7-de19-4b6f-ae27-7da48653efbb tempest-VolumesListAdminTestJSON-506346134 None] Created reservations ['e3eb8e58-9ae3-4c30-abbe-7796a9ddd337', '139f311a-6902-410d-8c57-a8b123859bbe', '261578f1-c884-483a-969e-fe214663b65b', '5d951f4b-d5d2-4ca5-9640-304fcc592ae2'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:38:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5eb824a7-de19-4b6f-ae27-7da48653efbb tempest-VolumesListAdminTestJSON-506346134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5eb824a7-de19-4b6f-ae27-7da48653efbb tempest-VolumesListAdminTestJSON-506346134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5eb824a7-de19-4b6f-ae27-7da48653efbb tempest-VolumesListAdminTestJSON-506346134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:38:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5eb824a7-de19-4b6f-ae27-7da48653efbb tempest-VolumesListAdminTestJSON-506346134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:38:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5eb824a7-de19-4b6f-ae27-7da48653efbb tempest-VolumesListAdminTestJSON-506346134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:38:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5eb824a7-de19-4b6f-ae27-7da48653efbb tempest-VolumesListAdminTestJSON-506346134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:51 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:38:51 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:51 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5eb824a7-de19-4b6f-ae27-7da48653efbb tempest-VolumesListAdminTestJSON-506346134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.258s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:51 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-5eb824a7-de19-4b6f-ae27-7da48653efbb tempest-VolumesListAdminTestJSON-506346134 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:38:51 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-5eb824a7-de19-4b6f-ae27-7da48653efbb tempest-VolumesListAdminTestJSON-506346134 None] Deleted volume successfully. Nov 06 14:38:51 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-5eb824a7-de19-4b6f-ae27-7da48653efbb tempest-VolumesListAdminTestJSON-506346134 None] Lock "cinder-398d0474-eabd-4de7-a272-1c42561a532e-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:38:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b7907ed4-6b59-4937-9e0d-8c1aec632260 tempest-VolumesActionsTest-114615455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:38:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b7907ed4-6b59-4937-9e0d-8c1aec632260 tempest-VolumesActionsTest-114615455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:38:52 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[e542b76e-b9f1-4533-97cd-c4d02c9a1c44]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:38:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b7907ed4-6b59-4937-9e0d-8c1aec632260 tempest-VolumesActionsTest-114615455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:52 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad Nov 06 14:38:52 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:52 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b7907ed4-6b59-4937-9e0d-8c1aec632260 tempest-VolumesActionsTest-114615455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad" returned: 0 in 0.398s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:52 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec79667-9f3a-46e5-8edd-0ea54356d420]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:38:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b7907ed4-6b59-4937-9e0d-8c1aec632260 tempest-VolumesActionsTest-114615455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:52 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad Nov 06 14:38:52 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:53 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b7907ed4-6b59-4937-9e0d-8c1aec632260 tempest-VolumesActionsTest-114615455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad" returned: 0 in 0.395s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b7907ed4-6b59-4937-9e0d-8c1aec632260 tempest-VolumesActionsTest-114615455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad /opt/stack/data/cinder/conversion/5c44feb5-883c-4874-b76d-34786bfa1bad.temp_image.1999d71b-3047-49d8-918a-a59085a725cch8xmbfq_.img {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:53 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad /opt/stack/data/cinder/conversion/5c44feb5-883c-4874-b76d-34786bfa1bad.temp_image.1999d71b-3047-49d8-918a-a59085a725cch8xmbfq_.img Nov 06 14:38:53 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:38:59 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Nov 06 14:38:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b7907ed4-6b59-4937-9e0d-8c1aec632260 tempest-VolumesActionsTest-114615455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad /opt/stack/data/cinder/conversion/5c44feb5-883c-4874-b76d-34786bfa1bad.temp_image.1999d71b-3047-49d8-918a-a59085a725cch8xmbfq_.img" returned: 0 in 6.525s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:38:59 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccf0007-46e6-47bf-93a5-5ee07e46ba22]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:38:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b7907ed4-6b59-4937-9e0d-8c1aec632260 tempest-VolumesActionsTest-114615455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:38:59 devstack sudo[100667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad Nov 06 14:38:59 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:00 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b7907ed4-6b59-4937-9e0d-8c1aec632260 tempest-VolumesActionsTest-114615455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad" returned: 0 in 0.540s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:00 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-b7907ed4-6b59-4937-9e0d-8c1aec632260 tempest-VolumesActionsTest-114615455 None] Image conversion details: src /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad, size 1024.00 MB, duration 6.53 sec, destination /opt/stack/data/cinder/conversion/5c44feb5-883c-4874-b76d-34786bfa1bad.temp_image.1999d71b-3047-49d8-918a-a59085a725cch8xmbfq_.img {{(pid=86854) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 14:39:00 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-b7907ed4-6b59-4937-9e0d-8c1aec632260 tempest-VolumesActionsTest-114615455 None] Converted 1024.00 MB image at 156.90 MB/s Nov 06 14:39:00 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-b7907ed4-6b59-4937-9e0d-8c1aec632260 tempest-VolumesActionsTest-114615455 None] 1999d71b-3047-49d8-918a-a59085a725cc was raw, no need to convert to raw {{(pid=86854) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 06 14:39:01 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:39:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Flow 'volume_create_manager' (b5c16d79-af42-41a0-804c-d20dede55b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:39:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab7c9a9-18f7-4124-b5f4-5ae6cf0b3ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab7c9a9-18f7-4124-b5f4-5ae6cf0b3ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-355449860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d28e6e7-a906-4e23-8c76-83a53ef8c248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90798e5cce474515b5cbf0df1077838c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:39:02Z,use_quota=True,user_id='805ce0657ad0403983bd4911885ba7c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fdc9bef-a1f3-4d74-b2c7-3f468fc7bee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fdc9bef-a1f3-4d74-b2c7-3f468fc7bee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c6da3c-6d26-40e4-a0d0-1689d54f35dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c6da3c-6d26-40e4-a0d0-1689d54f35dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d28e6e7-a906-4e23-8c76-83a53ef8c248', 'volume_name': 'volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c27d321c-a537-4d6e-8603-35ff1c2ba33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c27d321c-a537-4d6e-8603-35ff1c2ba33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82712fe1-3745-40de-bc42-6e54fd63ff74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:01 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Volume 8d28e6e7-a906-4e23-8c76-83a53ef8c248: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248', 'volume_size': 1} Nov 06 14:39:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:39:11 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:UPDATE=46,cinder:DELETE=4,cinder:SELECT=34,cinder:INSERT=8 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:39:16 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:UPDATE=43,cinder:SELECT=34,cinder:INSERT=13,cinder:DELETE=3 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:39:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b7907ed4-6b59-4937-9e0d-8c1aec632260 tempest-VolumesActionsTest-114615455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.563s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:39:18 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b7907ed4-6b59-4937-9e0d-8c1aec632260 tempest-VolumesActionsTest-114615455 None] Uploaded volume to glance image-id: 1999d71b-3047-49d8-918a-a59085a725cc. {{(pid=86854) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 06 14:39:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.067s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:39:18 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-355449860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d28e6e7-a906-4e23-8c76-83a53ef8c248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90798e5cce474515b5cbf0df1077838c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:39:02Z,use_quota=True,user_id='805ce0657ad0403983bd4911885ba7c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:39:18 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Creating volume 8d28e6e7-a906-4e23-8c76-83a53ef8c248 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:39:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:39:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:39:18 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:39:18 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:39:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:39:18 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:39:18 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:39:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:18 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248 1073741824 Nov 06 14:39:18 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:18 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-b7907ed4-6b59-4937-9e0d-8c1aec632260 tempest-VolumesActionsTest-114615455 None] Copy volume to image completed successfully. Nov 06 14:39:19 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248 1073741824" returned: 0 in 0.409s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:19 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248 Nov 06 14:39:19 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:19 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248" returned: 0 in 0.252s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:39:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:39:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82712fe1-3745-40de-bc42-6e54fd63ff74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f9b3060-12c0-43a6-b7d2-e34fb8ab8744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:19 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Volume volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248 (8d28e6e7-a906-4e23-8c76-83a53ef8c248): created successfully Nov 06 14:39:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f9b3060-12c0-43a6-b7d2-e34fb8ab8744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Flow 'volume_create_manager' (b5c16d79-af42-41a0-804c-d20dede55b89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:39:19 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-26923494-5067-47f7-8534-f65e16594b7f tempest-SnapshotMetadataTestJSON-539727961 None] Created volume successfully. Nov 06 14:39:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5ce4a385-48c6-476a-b1c7-f7dfa4729f66 tempest-SnapshotMetadataTestJSON-539727961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:39:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5ce4a385-48c6-476a-b1c7-f7dfa4729f66 tempest-SnapshotMetadataTestJSON-539727961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:39:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-5ce4a385-48c6-476a-b1c7-f7dfa4729f66 tempest-SnapshotMetadataTestJSON-539727961 None] Creating offline snapshot 79b8fce8-ab04-4401-9408-62e2463dd52e of volume 8d28e6e7-a906-4e23-8c76-83a53ef8c248 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:39:20 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df4bd76-d24d-4bd9-b237-e122d7b2f1f8]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:39:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5ce4a385-48c6-476a-b1c7-f7dfa4729f66 tempest-SnapshotMetadataTestJSON-539727961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:20 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248 Nov 06 14:39:20 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-973d4f62-7803-479d-8bed-4c57ae7db252 tempest-VolumesActionsTest-114615455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:39:20 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5ce4a385-48c6-476a-b1c7-f7dfa4729f66 tempest-SnapshotMetadataTestJSON-539727961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248" returned: 0 in 0.374s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5ce4a385-48c6-476a-b1c7-f7dfa4729f66 tempest-SnapshotMetadataTestJSON-539727961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248.79b8fce8-ab04-4401-9408-62e2463dd52e 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:20 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248.79b8fce8-ab04-4401-9408-62e2463dd52e 1G Nov 06 14:39:20 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:20 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5ce4a385-48c6-476a-b1c7-f7dfa4729f66 tempest-SnapshotMetadataTestJSON-539727961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248.79b8fce8-ab04-4401-9408-62e2463dd52e 1G" returned: 0 in 0.389s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5ce4a385-48c6-476a-b1c7-f7dfa4729f66 tempest-SnapshotMetadataTestJSON-539727961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248.79b8fce8-ab04-4401-9408-62e2463dd52e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:20 devstack sudo[100739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248.79b8fce8-ab04-4401-9408-62e2463dd52e Nov 06 14:39:20 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:21 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5ce4a385-48c6-476a-b1c7-f7dfa4729f66 tempest-SnapshotMetadataTestJSON-539727961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248.79b8fce8-ab04-4401-9408-62e2463dd52e" returned: 0 in 0.283s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:21 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-5ce4a385-48c6-476a-b1c7-f7dfa4729f66 tempest-SnapshotMetadataTestJSON-539727961 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248.79b8fce8-ab04-4401-9408-62e2463dd52e is being set with open permissions: ugo+rw Nov 06 14:39:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5ce4a385-48c6-476a-b1c7-f7dfa4729f66 tempest-SnapshotMetadataTestJSON-539727961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248.79b8fce8-ab04-4401-9408-62e2463dd52e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:21 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248.79b8fce8-ab04-4401-9408-62e2463dd52e Nov 06 14:39:21 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:21 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5ce4a385-48c6-476a-b1c7-f7dfa4729f66 tempest-SnapshotMetadataTestJSON-539727961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248.79b8fce8-ab04-4401-9408-62e2463dd52e" returned: 0 in 0.230s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5ce4a385-48c6-476a-b1c7-f7dfa4729f66 tempest-SnapshotMetadataTestJSON-539727961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:21 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248.info Nov 06 14:39:21 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:21 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5ce4a385-48c6-476a-b1c7-f7dfa4729f66 tempest-SnapshotMetadataTestJSON-539727961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248.info" returned: 0 in 0.248s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:21 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-5ce4a385-48c6-476a-b1c7-f7dfa4729f66 tempest-SnapshotMetadataTestJSON-539727961 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248.info is being set with open permissions: ugo+rw Nov 06 14:39:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5ce4a385-48c6-476a-b1c7-f7dfa4729f66 tempest-SnapshotMetadataTestJSON-539727961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:21 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248.info Nov 06 14:39:21 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:21 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5ce4a385-48c6-476a-b1c7-f7dfa4729f66 tempest-SnapshotMetadataTestJSON-539727961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248.info" returned: 0 in 0.237s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5ce4a385-48c6-476a-b1c7-f7dfa4729f66 tempest-SnapshotMetadataTestJSON-539727961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.850s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:39:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-973d4f62-7803-479d-8bed-4c57ae7db252 tempest-VolumesActionsTest-114615455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.501s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:39:21 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47e6f2b-74e6-4f3c-9ba1-e71cf037eb55]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:39:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-973d4f62-7803-479d-8bed-4c57ae7db252 tempest-VolumesActionsTest-114615455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:21 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-5ce4a385-48c6-476a-b1c7-f7dfa4729f66 tempest-SnapshotMetadataTestJSON-539727961 None] Create snapshot completed successfully Nov 06 14:39:21 devstack sudo[100753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad Nov 06 14:39:21 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:22 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-973d4f62-7803-479d-8bed-4c57ae7db252 tempest-VolumesActionsTest-114615455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad" returned: 0 in 0.371s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:22 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e58999f-522b-47e7-805b-845c3f5e71e3]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:39:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-973d4f62-7803-479d-8bed-4c57ae7db252 tempest-VolumesActionsTest-114615455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:22 devstack sudo[100758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad Nov 06 14:39:22 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:22 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-973d4f62-7803-479d-8bed-4c57ae7db252 tempest-VolumesActionsTest-114615455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad" returned: 0 in 0.382s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-973d4f62-7803-479d-8bed-4c57ae7db252 tempest-VolumesActionsTest-114615455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad /opt/stack/data/cinder/conversion/5c44feb5-883c-4874-b76d-34786bfa1bad.temp_image.9a268759-c033-4793-92ed-2e036504d7b7g9aah20a.img {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:22 devstack sudo[100763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad /opt/stack/data/cinder/conversion/5c44feb5-883c-4874-b76d-34786bfa1bad.temp_image.9a268759-c033-4793-92ed-2e036504d7b7g9aah20a.img Nov 06 14:39:22 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-49105317-1e9f-4fe3-b96a-00c810cd8dc0 tempest-SnapshotMetadataTestJSON-539727961 None] Acquiring lock "cinder-79b8fce8-ab04-4401-9408-62e2463dd52e-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:39:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-49105317-1e9f-4fe3-b96a-00c810cd8dc0 tempest-SnapshotMetadataTestJSON-539727961 None] Lock "cinder-79b8fce8-ab04-4401-9408-62e2463dd52e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:39:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-49105317-1e9f-4fe3-b96a-00c810cd8dc0 tempest-SnapshotMetadataTestJSON-539727961 None] Acquiring lock "cinder-quobyte-8d28e6e7-a906-4e23-8c76-83a53ef8c248" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:39:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-49105317-1e9f-4fe3-b96a-00c810cd8dc0 tempest-SnapshotMetadataTestJSON-539727961 None] Lock "cinder-quobyte-8d28e6e7-a906-4e23-8c76-83a53ef8c248" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:39:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-49105317-1e9f-4fe3-b96a-00c810cd8dc0 tempest-SnapshotMetadataTestJSON-539727961 None] Acquiring lock "cinder-quobyte-79b8fce8-ab04-4401-9408-62e2463dd52e" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:39:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-49105317-1e9f-4fe3-b96a-00c810cd8dc0 tempest-SnapshotMetadataTestJSON-539727961 None] Lock "cinder-quobyte-79b8fce8-ab04-4401-9408-62e2463dd52e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:39:22 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-49105317-1e9f-4fe3-b96a-00c810cd8dc0 tempest-SnapshotMetadataTestJSON-539727961 None] Deleting offline snapshot 79b8fce8-ab04-4401-9408-62e2463dd52e of volume 8d28e6e7-a906-4e23-8c76-83a53ef8c248 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:39:22 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-49105317-1e9f-4fe3-b96a-00c810cd8dc0 tempest-SnapshotMetadataTestJSON-539727961 None] snapshot_file for this snap is: volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248.79b8fce8-ab04-4401-9408-62e2463dd52e {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:39:22 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfc6e24-55bc-484d-b410-bca60af3af3c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:39:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-49105317-1e9f-4fe3-b96a-00c810cd8dc0 tempest-SnapshotMetadataTestJSON-539727961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248.79b8fce8-ab04-4401-9408-62e2463dd52e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:23 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248.79b8fce8-ab04-4401-9408-62e2463dd52e Nov 06 14:39:23 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:39:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:39:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:39:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:39:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:39:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:39:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:23 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:39:23 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:23 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-49105317-1e9f-4fe3-b96a-00c810cd8dc0 tempest-SnapshotMetadataTestJSON-539727961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248.79b8fce8-ab04-4401-9408-62e2463dd52e" returned: 0 in 0.606s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-49105317-1e9f-4fe3-b96a-00c810cd8dc0 tempest-SnapshotMetadataTestJSON-539727961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:39:23 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50d64d9-2011-4b7b-acb4-edb92bc51753]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:39:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-49105317-1e9f-4fe3-b96a-00c810cd8dc0 tempest-SnapshotMetadataTestJSON-539727961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:23 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.506s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:23 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:39:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager._thread_info {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:39:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread count: 28 {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 14:39:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread info: [<_MainThread(MainThread, started 130306900594816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 14:39:23 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248 Nov 06 14:39:23 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:24 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-49105317-1e9f-4fe3-b96a-00c810cd8dc0 tempest-SnapshotMetadataTestJSON-539727961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248" returned: 0 in 0.594s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-49105317-1e9f-4fe3-b96a-00c810cd8dc0 tempest-SnapshotMetadataTestJSON-539727961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248.79b8fce8-ab04-4401-9408-62e2463dd52e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:24 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248.79b8fce8-ab04-4401-9408-62e2463dd52e Nov 06 14:39:24 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:24 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-49105317-1e9f-4fe3-b96a-00c810cd8dc0 tempest-SnapshotMetadataTestJSON-539727961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248.79b8fce8-ab04-4401-9408-62e2463dd52e" returned: 0 in 0.553s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-49105317-1e9f-4fe3-b96a-00c810cd8dc0 tempest-SnapshotMetadataTestJSON-539727961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248.79b8fce8-ab04-4401-9408-62e2463dd52e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:24 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248.79b8fce8-ab04-4401-9408-62e2463dd52e Nov 06 14:39:24 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:25 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-49105317-1e9f-4fe3-b96a-00c810cd8dc0 tempest-SnapshotMetadataTestJSON-539727961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248.79b8fce8-ab04-4401-9408-62e2463dd52e" returned: 0 in 0.398s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:25 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-49105317-1e9f-4fe3-b96a-00c810cd8dc0 tempest-SnapshotMetadataTestJSON-539727961 None] Lock "cinder-quobyte-79b8fce8-ab04-4401-9408-62e2463dd52e" released by "_delete_snapshot" :: held 2.358s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:39:25 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-49105317-1e9f-4fe3-b96a-00c810cd8dc0 tempest-SnapshotMetadataTestJSON-539727961 None] Lock "cinder-quobyte-8d28e6e7-a906-4e23-8c76-83a53ef8c248" released by "delete_snapshot" :: held 2.392s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:39:25 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-49105317-1e9f-4fe3-b96a-00c810cd8dc0 tempest-SnapshotMetadataTestJSON-539727961 None] Created reservations ['a0e17679-b729-4a4a-adce-c81abc76adf3', 'd0015a56-4f63-4bae-9c9f-33705cbcbf94', 'ec42472c-87c0-4c38-aab8-755205259c0e', '5f6b22c1-3d5a-4b05-aa3d-211894d23b8e'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:39:25 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-49105317-1e9f-4fe3-b96a-00c810cd8dc0 tempest-SnapshotMetadataTestJSON-539727961 None] Delete snapshot completed successfully. Nov 06 14:39:25 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-49105317-1e9f-4fe3-b96a-00c810cd8dc0 tempest-SnapshotMetadataTestJSON-539727961 None] Lock "cinder-79b8fce8-ab04-4401-9408-62e2463dd52e-delete_snapshot" released by "delete_snapshot" :: held 2.596s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:39:26 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f619d290-8553-41c4-bb61-d27e4f962c03 tempest-SnapshotMetadataTestJSON-539727961 None] Acquiring lock "cinder-8d28e6e7-a906-4e23-8c76-83a53ef8c248-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:39:26 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f619d290-8553-41c4-bb61-d27e4f962c03 tempest-SnapshotMetadataTestJSON-539727961 None] Lock "cinder-8d28e6e7-a906-4e23-8c76-83a53ef8c248-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:39:26 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f619d290-8553-41c4-bb61-d27e4f962c03 tempest-SnapshotMetadataTestJSON-539727961 None] Acquiring lock "cinder-quobyte-8d28e6e7-a906-4e23-8c76-83a53ef8c248" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:39:26 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f619d290-8553-41c4-bb61-d27e4f962c03 tempest-SnapshotMetadataTestJSON-539727961 None] Lock "cinder-quobyte-8d28e6e7-a906-4e23-8c76-83a53ef8c248" acquired by "delete_volume" :: waited 0.036s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:39:26 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b780e41-2087-4ff1-81fc-7e47e66fe194]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:39:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f619d290-8553-41c4-bb61-d27e4f962c03 tempest-SnapshotMetadataTestJSON-539727961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:26 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248 Nov 06 14:39:26 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:27 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f619d290-8553-41c4-bb61-d27e4f962c03 tempest-SnapshotMetadataTestJSON-539727961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248" returned: 0 in 0.601s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f619d290-8553-41c4-bb61-d27e4f962c03 tempest-SnapshotMetadataTestJSON-539727961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:27 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248 Nov 06 14:39:27 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:27 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f619d290-8553-41c4-bb61-d27e4f962c03 tempest-SnapshotMetadataTestJSON-539727961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d28e6e7-a906-4e23-8c76-83a53ef8c248" returned: 0 in 0.353s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:27 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f619d290-8553-41c4-bb61-d27e4f962c03 tempest-SnapshotMetadataTestJSON-539727961 None] Lock "cinder-quobyte-8d28e6e7-a906-4e23-8c76-83a53ef8c248" released by "delete_volume" :: held 1.096s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:39:27 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-f619d290-8553-41c4-bb61-d27e4f962c03 tempest-SnapshotMetadataTestJSON-539727961 None] Created reservations ['e566b88f-da0d-4ca5-9dce-5764bade32e2', 'fa34bfb1-0074-4d98-854e-9a4e6f979195', '27c637e6-e8d5-4fbd-b9a2-b7895edf93df', 'ea79431e-74ff-4257-9690-8547b54e796c'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:39:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f619d290-8553-41c4-bb61-d27e4f962c03 tempest-SnapshotMetadataTestJSON-539727961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:39:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f619d290-8553-41c4-bb61-d27e4f962c03 tempest-SnapshotMetadataTestJSON-539727961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:39:27 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f619d290-8553-41c4-bb61-d27e4f962c03 tempest-SnapshotMetadataTestJSON-539727961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:39:27 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f619d290-8553-41c4-bb61-d27e4f962c03 tempest-SnapshotMetadataTestJSON-539727961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:39:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f619d290-8553-41c4-bb61-d27e4f962c03 tempest-SnapshotMetadataTestJSON-539727961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:39:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f619d290-8553-41c4-bb61-d27e4f962c03 tempest-SnapshotMetadataTestJSON-539727961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:27 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:39:27 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:27 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f619d290-8553-41c4-bb61-d27e4f962c03 tempest-SnapshotMetadataTestJSON-539727961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.348s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:27 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-f619d290-8553-41c4-bb61-d27e4f962c03 tempest-SnapshotMetadataTestJSON-539727961 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:39:27 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-f619d290-8553-41c4-bb61-d27e4f962c03 tempest-SnapshotMetadataTestJSON-539727961 None] Deleted volume successfully. Nov 06 14:39:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f619d290-8553-41c4-bb61-d27e4f962c03 tempest-SnapshotMetadataTestJSON-539727961 None] Lock "cinder-8d28e6e7-a906-4e23-8c76-83a53ef8c248-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:39:29 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-973d4f62-7803-479d-8bed-4c57ae7db252 tempest-VolumesActionsTest-114615455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad /opt/stack/data/cinder/conversion/5c44feb5-883c-4874-b76d-34786bfa1bad.temp_image.9a268759-c033-4793-92ed-2e036504d7b7g9aah20a.img" returned: 0 in 6.650s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:29 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2392d47-9337-4925-8fd8-654e7af54c82]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:39:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-973d4f62-7803-479d-8bed-4c57ae7db252 tempest-VolumesActionsTest-114615455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:29 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad Nov 06 14:39:29 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:29 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-973d4f62-7803-479d-8bed-4c57ae7db252 tempest-VolumesActionsTest-114615455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad" returned: 0 in 0.547s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:29 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-973d4f62-7803-479d-8bed-4c57ae7db252 tempest-VolumesActionsTest-114615455 None] Image conversion details: src /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad, size 1024.00 MB, duration 6.65 sec, destination /opt/stack/data/cinder/conversion/5c44feb5-883c-4874-b76d-34786bfa1bad.temp_image.9a268759-c033-4793-92ed-2e036504d7b7g9aah20a.img {{(pid=86854) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 14:39:29 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-973d4f62-7803-479d-8bed-4c57ae7db252 tempest-VolumesActionsTest-114615455 None] Converted 1024.00 MB image at 153.96 MB/s Nov 06 14:39:29 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-973d4f62-7803-479d-8bed-4c57ae7db252 tempest-VolumesActionsTest-114615455 None] 9a268759-c033-4793-92ed-2e036504d7b7 was raw, converting to qcow2 {{(pid=86854) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 06 14:39:29 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f97c84-0d50-41e0-a649-f957787855f9]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:39:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-973d4f62-7803-479d-8bed-4c57ae7db252 tempest-VolumesActionsTest-114615455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5c44feb5-883c-4874-b76d-34786bfa1bad.temp_image.9a268759-c033-4793-92ed-2e036504d7b7g9aah20a.img {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:29 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5c44feb5-883c-4874-b76d-34786bfa1bad.temp_image.9a268759-c033-4793-92ed-2e036504d7b7g9aah20a.img Nov 06 14:39:29 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:30 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-973d4f62-7803-479d-8bed-4c57ae7db252 tempest-VolumesActionsTest-114615455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5c44feb5-883c-4874-b76d-34786bfa1bad.temp_image.9a268759-c033-4793-92ed-2e036504d7b7g9aah20a.img" returned: 0 in 0.344s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-973d4f62-7803-479d-8bed-4c57ae7db252 tempest-VolumesActionsTest-114615455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5c44feb5-883c-4874-b76d-34786bfa1bad.temp_image.9a268759-c033-4793-92ed-2e036504d7b7g9aah20a.img {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:30 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5c44feb5-883c-4874-b76d-34786bfa1bad.temp_image.9a268759-c033-4793-92ed-2e036504d7b7g9aah20a.img Nov 06 14:39:30 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:30 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-973d4f62-7803-479d-8bed-4c57ae7db252 tempest-VolumesActionsTest-114615455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5c44feb5-883c-4874-b76d-34786bfa1bad.temp_image.9a268759-c033-4793-92ed-2e036504d7b7g9aah20a.img" returned: 1 in 0.317s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-973d4f62-7803-479d-8bed-4c57ae7db252 tempest-VolumesActionsTest-114615455 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5c44feb5-883c-4874-b76d-34786bfa1bad.temp_image.9a268759-c033-4793-92ed-2e036504d7b7g9aah20a.img' failed. Not Retrying. {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 14:39:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-973d4f62-7803-479d-8bed-4c57ae7db252 tempest-VolumesActionsTest-114615455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5c44feb5-883c-4874-b76d-34786bfa1bad.temp_image.9a268759-c033-4793-92ed-2e036504d7b7g9aah20a.img /opt/stack/data/cinder/conversion/vol_upload_d0_qai1q {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:30 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5c44feb5-883c-4874-b76d-34786bfa1bad.temp_image.9a268759-c033-4793-92ed-2e036504d7b7g9aah20a.img /opt/stack/data/cinder/conversion/vol_upload_d0_qai1q Nov 06 14:39:30 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:30 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-973d4f62-7803-479d-8bed-4c57ae7db252 tempest-VolumesActionsTest-114615455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5c44feb5-883c-4874-b76d-34786bfa1bad.temp_image.9a268759-c033-4793-92ed-2e036504d7b7g9aah20a.img /opt/stack/data/cinder/conversion/vol_upload_d0_qai1q" returned: 0 in 0.251s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:30 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-973d4f62-7803-479d-8bed-4c57ae7db252 tempest-VolumesActionsTest-114615455 None] Image conversion details: src /opt/stack/data/cinder/conversion/5c44feb5-883c-4874-b76d-34786bfa1bad.temp_image.9a268759-c033-4793-92ed-2e036504d7b7g9aah20a.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_d0_qai1q {{(pid=86854) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 14:39:30 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-973d4f62-7803-479d-8bed-4c57ae7db252 tempest-VolumesActionsTest-114615455 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 06 14:39:30 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af94ed3-f416-4886-907e-cf10a67afa65]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:39:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-973d4f62-7803-479d-8bed-4c57ae7db252 tempest-VolumesActionsTest-114615455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_d0_qai1q {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:30 devstack sudo[100832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_d0_qai1q Nov 06 14:39:30 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:31 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-973d4f62-7803-479d-8bed-4c57ae7db252 tempest-VolumesActionsTest-114615455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_d0_qai1q" returned: 0 in 0.325s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:32 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:39:32 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Flow 'volume_create_manager' (c980cd70-6ff6-4c16-a05b-369e51f7c7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:39:32 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5e3154-6ed7-4d00-9d9b-830a614a1c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:32 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5e3154-6ed7-4d00-9d9b-830a614a1c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1375716879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b361bc-0654-42e5-8107-0a0b274e80e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd211e1e7dc4c4d9b52911950daedaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:39:32Z,use_quota=True,user_id='df928e0051e345cf9a46dfe9f7b1d5e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:32 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7dfd7a4-737b-4a29-8e8b-cd4bbf0f8b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:32 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7dfd7a4-737b-4a29-8e8b-cd4bbf0f8b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:32 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a1eead-8fa5-4ad6-90a8-f41ee5474415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:32 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a1eead-8fa5-4ad6-90a8-f41ee5474415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3b361bc-0654-42e5-8107-0a0b274e80e6', 'volume_name': 'volume-f3b361bc-0654-42e5-8107-0a0b274e80e6', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:32 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ed4ce4-4846-4570-9683-0afd27fd0a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:32 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ed4ce4-4846-4570-9683-0afd27fd0a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:32 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad47c6e-35ee-471e-831a-79e0ed518bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:32 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Volume f3b361bc-0654-42e5-8107-0a0b274e80e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3b361bc-0654-42e5-8107-0a0b274e80e6', 'volume_size': 1} Nov 06 14:39:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:39:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-973d4f62-7803-479d-8bed-4c57ae7db252 tempest-VolumesActionsTest-114615455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.616s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:39:32 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-973d4f62-7803-479d-8bed-4c57ae7db252 tempest-VolumesActionsTest-114615455 None] Uploaded volume to glance image-id: 9a268759-c033-4793-92ed-2e036504d7b7. {{(pid=86854) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 06 14:39:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.079s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:39:32 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1375716879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b361bc-0654-42e5-8107-0a0b274e80e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd211e1e7dc4c4d9b52911950daedaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:39:32Z,use_quota=True,user_id='df928e0051e345cf9a46dfe9f7b1d5e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:39:32 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Creating volume f3b361bc-0654-42e5-8107-0a0b274e80e6 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:39:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:39:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:39:32 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:39:32 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:39:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:39:32 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:39:32 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:39:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:32 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6 1073741824 Nov 06 14:39:32 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:32 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-973d4f62-7803-479d-8bed-4c57ae7db252 tempest-VolumesActionsTest-114615455 None] Copy volume to image completed successfully. Nov 06 14:39:32 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6 1073741824" returned: 0 in 0.419s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:32 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6 Nov 06 14:39:32 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:33 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6" returned: 0 in 0.245s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:39:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:39:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad47c6e-35ee-471e-831a-79e0ed518bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3b361bc-0654-42e5-8107-0a0b274e80e6', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b2acd5-9f87-4b9e-9553-abf32447bf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:33 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Volume volume-f3b361bc-0654-42e5-8107-0a0b274e80e6 (f3b361bc-0654-42e5-8107-0a0b274e80e6): created successfully Nov 06 14:39:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b2acd5-9f87-4b9e-9553-abf32447bf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Flow 'volume_create_manager' (c980cd70-6ff6-4c16-a05b-369e51f7c7b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:39:33 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-8fa656fa-e3cc-4c64-a06c-b4f40f66bfb9 tempest-VolumesDeleteCascade-1298520909 None] Created volume successfully. Nov 06 14:39:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-98d01120-2ab4-461b-8b8e-2daf6b6b4e49 tempest-VolumesActionsTest-114615455 None] Acquiring lock "cinder-5c44feb5-883c-4874-b76d-34786bfa1bad-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:39:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-98d01120-2ab4-461b-8b8e-2daf6b6b4e49 tempest-VolumesActionsTest-114615455 None] Lock "cinder-5c44feb5-883c-4874-b76d-34786bfa1bad-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:39:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-98d01120-2ab4-461b-8b8e-2daf6b6b4e49 tempest-VolumesActionsTest-114615455 None] Acquiring lock "cinder-quobyte-5c44feb5-883c-4874-b76d-34786bfa1bad" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:39:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-98d01120-2ab4-461b-8b8e-2daf6b6b4e49 tempest-VolumesActionsTest-114615455 None] Lock "cinder-quobyte-5c44feb5-883c-4874-b76d-34786bfa1bad" acquired by "delete_volume" :: waited 0.014s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:39:33 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c9215f-bda3-4af4-a7e4-79693e1e7202]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:39:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-98d01120-2ab4-461b-8b8e-2daf6b6b4e49 tempest-VolumesActionsTest-114615455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:33 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad Nov 06 14:39:33 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:34 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-98d01120-2ab4-461b-8b8e-2daf6b6b4e49 tempest-VolumesActionsTest-114615455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad" returned: 0 in 0.352s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-98d01120-2ab4-461b-8b8e-2daf6b6b4e49 tempest-VolumesActionsTest-114615455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:34 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad Nov 06 14:39:34 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:34 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-98d01120-2ab4-461b-8b8e-2daf6b6b4e49 tempest-VolumesActionsTest-114615455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5c44feb5-883c-4874-b76d-34786bfa1bad" returned: 0 in 0.244s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:34 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-98d01120-2ab4-461b-8b8e-2daf6b6b4e49 tempest-VolumesActionsTest-114615455 None] Lock "cinder-quobyte-5c44feb5-883c-4874-b76d-34786bfa1bad" released by "delete_volume" :: held 0.636s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:39:34 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-98d01120-2ab4-461b-8b8e-2daf6b6b4e49 tempest-VolumesActionsTest-114615455 None] Created reservations ['c06ba6d3-3544-4bae-9c5f-270f3b47ac1d', '3f56d4f6-167a-4f80-a384-0fccbae51959', '856ec7a6-cb39-43c5-a430-93570a9e39ad', '7e38f2c6-b72e-4a30-a409-dd6bd515dda1'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:39:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-98d01120-2ab4-461b-8b8e-2daf6b6b4e49 tempest-VolumesActionsTest-114615455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:39:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-98d01120-2ab4-461b-8b8e-2daf6b6b4e49 tempest-VolumesActionsTest-114615455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:39:34 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-98d01120-2ab4-461b-8b8e-2daf6b6b4e49 tempest-VolumesActionsTest-114615455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:39:34 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-98d01120-2ab4-461b-8b8e-2daf6b6b4e49 tempest-VolumesActionsTest-114615455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:39:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-98d01120-2ab4-461b-8b8e-2daf6b6b4e49 tempest-VolumesActionsTest-114615455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:39:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-98d01120-2ab4-461b-8b8e-2daf6b6b4e49 tempest-VolumesActionsTest-114615455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:34 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:39:34 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-539af7e6-a925-4716-acc9-38bc058273f6 tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:39:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-539af7e6-a925-4716-acc9-38bc058273f6 tempest-VolumesDeleteCascade-1298520909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:39:34 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-539af7e6-a925-4716-acc9-38bc058273f6 tempest-VolumesDeleteCascade-1298520909 None] Creating offline snapshot d07b576d-ea5e-4361-97c1-23c1341749cf of volume f3b361bc-0654-42e5-8107-0a0b274e80e6 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:39:34 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[311803a3-d80e-486f-9448-8a27baeef4ca]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:39:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-539af7e6-a925-4716-acc9-38bc058273f6 tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:34 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-98d01120-2ab4-461b-8b8e-2daf6b6b4e49 tempest-VolumesActionsTest-114615455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.260s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:34 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-98d01120-2ab4-461b-8b8e-2daf6b6b4e49 tempest-VolumesActionsTest-114615455 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:39:34 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-98d01120-2ab4-461b-8b8e-2daf6b6b4e49 tempest-VolumesActionsTest-114615455 None] Deleted volume successfully. Nov 06 14:39:34 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-98d01120-2ab4-461b-8b8e-2daf6b6b4e49 tempest-VolumesActionsTest-114615455 None] Lock "cinder-5c44feb5-883c-4874-b76d-34786bfa1bad-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:39:34 devstack sudo[100855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6 Nov 06 14:39:34 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:34 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-539af7e6-a925-4716-acc9-38bc058273f6 tempest-VolumesDeleteCascade-1298520909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6" returned: 0 in 0.374s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-539af7e6-a925-4716-acc9-38bc058273f6 tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:34 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf 1G Nov 06 14:39:34 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:35 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-539af7e6-a925-4716-acc9-38bc058273f6 tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf 1G" returned: 0 in 0.428s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-539af7e6-a925-4716-acc9-38bc058273f6 tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3b361bc-0654-42e5-8107-0a0b274e80e6 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:35 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3b361bc-0654-42e5-8107-0a0b274e80e6 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf Nov 06 14:39:35 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:35 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-539af7e6-a925-4716-acc9-38bc058273f6 tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3b361bc-0654-42e5-8107-0a0b274e80e6 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf" returned: 0 in 0.301s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:35 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-539af7e6-a925-4716-acc9-38bc058273f6 tempest-VolumesDeleteCascade-1298520909 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf is being set with open permissions: ugo+rw Nov 06 14:39:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-539af7e6-a925-4716-acc9-38bc058273f6 tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:35 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf Nov 06 14:39:35 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:35 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-539af7e6-a925-4716-acc9-38bc058273f6 tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf" returned: 0 in 0.274s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-539af7e6-a925-4716-acc9-38bc058273f6 tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:36 devstack sudo[100876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.info Nov 06 14:39:36 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:36 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-539af7e6-a925-4716-acc9-38bc058273f6 tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.info" returned: 0 in 0.246s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:36 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-539af7e6-a925-4716-acc9-38bc058273f6 tempest-VolumesDeleteCascade-1298520909 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.info is being set with open permissions: ugo+rw Nov 06 14:39:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-539af7e6-a925-4716-acc9-38bc058273f6 tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:36 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.info Nov 06 14:39:36 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:36 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-539af7e6-a925-4716-acc9-38bc058273f6 tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.info" returned: 0 in 0.259s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-539af7e6-a925-4716-acc9-38bc058273f6 tempest-VolumesDeleteCascade-1298520909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.984s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:39:36 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-539af7e6-a925-4716-acc9-38bc058273f6 tempest-VolumesDeleteCascade-1298520909 None] Create snapshot completed successfully Nov 06 14:39:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c0e4e254-6f69-4d75-acfe-ec2c207d449a tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:39:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c0e4e254-6f69-4d75-acfe-ec2c207d449a tempest-VolumesDeleteCascade-1298520909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:39:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-c0e4e254-6f69-4d75-acfe-ec2c207d449a tempest-VolumesDeleteCascade-1298520909 None] Creating offline snapshot 9b7c0bac-5fd4-4881-9574-f154907de05a of volume f3b361bc-0654-42e5-8107-0a0b274e80e6 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:39:36 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55f34cb-7673-4751-8e58-303dfaceebac]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:39:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c0e4e254-6f69-4d75-acfe-ec2c207d449a tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:37 devstack sudo[100882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf Nov 06 14:39:37 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:37 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c0e4e254-6f69-4d75-acfe-ec2c207d449a tempest-VolumesDeleteCascade-1298520909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf" returned: 0 in 0.356s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:37 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-c0e4e254-6f69-4d75-acfe-ec2c207d449a tempest-VolumesDeleteCascade-1298520909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3b361bc-0654-42e5-8107-0a0b274e80e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:39:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c0e4e254-6f69-4d75-acfe-ec2c207d449a tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.9b7c0bac-5fd4-4881-9574-f154907de05a 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:37 devstack sudo[100887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.9b7c0bac-5fd4-4881-9574-f154907de05a 1G Nov 06 14:39:37 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:37 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c0e4e254-6f69-4d75-acfe-ec2c207d449a tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.9b7c0bac-5fd4-4881-9574-f154907de05a 1G" returned: 0 in 0.450s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c0e4e254-6f69-4d75-acfe-ec2c207d449a tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.9b7c0bac-5fd4-4881-9574-f154907de05a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:37 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.9b7c0bac-5fd4-4881-9574-f154907de05a Nov 06 14:39:37 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:38 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c0e4e254-6f69-4d75-acfe-ec2c207d449a tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.9b7c0bac-5fd4-4881-9574-f154907de05a" returned: 0 in 0.341s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:38 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-c0e4e254-6f69-4d75-acfe-ec2c207d449a tempest-VolumesDeleteCascade-1298520909 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.9b7c0bac-5fd4-4881-9574-f154907de05a is being set with open permissions: ugo+rw Nov 06 14:39:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c0e4e254-6f69-4d75-acfe-ec2c207d449a tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.9b7c0bac-5fd4-4881-9574-f154907de05a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:38 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.9b7c0bac-5fd4-4881-9574-f154907de05a Nov 06 14:39:38 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:38 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c0e4e254-6f69-4d75-acfe-ec2c207d449a tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.9b7c0bac-5fd4-4881-9574-f154907de05a" returned: 0 in 0.257s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c0e4e254-6f69-4d75-acfe-ec2c207d449a tempest-VolumesDeleteCascade-1298520909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.540s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:39:38 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-c0e4e254-6f69-4d75-acfe-ec2c207d449a tempest-VolumesDeleteCascade-1298520909 None] Create snapshot completed successfully Nov 06 14:39:39 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "cinder-f3b361bc-0654-42e5-8107-0a0b274e80e6-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:39:39 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-f3b361bc-0654-42e5-8107-0a0b274e80e6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:39:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Performing cascade delete. {{(pid=86854) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 06 14:39:39 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "cinder-9b7c0bac-5fd4-4881-9574-f154907de05a-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:39:39 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-9b7c0bac-5fd4-4881-9574-f154907de05a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:39:39 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "cinder-quobyte-f3b361bc-0654-42e5-8107-0a0b274e80e6" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:39:39 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-quobyte-f3b361bc-0654-42e5-8107-0a0b274e80e6" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:39:39 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "cinder-quobyte-9b7c0bac-5fd4-4881-9574-f154907de05a" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:39:39 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-quobyte-9b7c0bac-5fd4-4881-9574-f154907de05a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:39:39 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Deleting offline snapshot 9b7c0bac-5fd4-4881-9574-f154907de05a of volume f3b361bc-0654-42e5-8107-0a0b274e80e6 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:39:39 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] snapshot_file for this snap is: volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.9b7c0bac-5fd4-4881-9574-f154907de05a {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:39:39 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f7fd2c-a03b-449e-9b61-8e2d85860438]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:39:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.9b7c0bac-5fd4-4881-9574-f154907de05a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:39 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.9b7c0bac-5fd4-4881-9574-f154907de05a Nov 06 14:39:39 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:39 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.9b7c0bac-5fd4-4881-9574-f154907de05a" returned: 0 in 0.424s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:39 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3b361bc-0654-42e5-8107-0a0b274e80e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:39:39 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e823faa-c6f1-43b2-b5c7-b816b9525b70]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:39:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:39 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf Nov 06 14:39:39 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:40 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf" returned: 0 in 0.367s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:40 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3b361bc-0654-42e5-8107-0a0b274e80e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:39:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.9b7c0bac-5fd4-4881-9574-f154907de05a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:40 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.9b7c0bac-5fd4-4881-9574-f154907de05a Nov 06 14:39:40 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:40 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.9b7c0bac-5fd4-4881-9574-f154907de05a" returned: 0 in 0.392s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.9b7c0bac-5fd4-4881-9574-f154907de05a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:40 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.9b7c0bac-5fd4-4881-9574-f154907de05a Nov 06 14:39:40 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:40 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.9b7c0bac-5fd4-4881-9574-f154907de05a" returned: 0 in 0.255s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:40 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-quobyte-9b7c0bac-5fd4-4881-9574-f154907de05a" released by "_delete_snapshot" :: held 1.559s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:39:40 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-quobyte-f3b361bc-0654-42e5-8107-0a0b274e80e6" released by "delete_snapshot" :: held 1.580s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:39:40 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Created reservations ['ac7c2246-06f6-460a-9471-bdcad1c30f93', '1bfd00b6-1c7c-4803-b08b-5d12b110232c', '42898474-e97e-4883-80d6-95df045a8add', '323555c7-cd85-4c9e-807d-50d031e2472b'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:39:40 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Delete snapshot completed successfully. Nov 06 14:39:40 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-9b7c0bac-5fd4-4881-9574-f154907de05a-delete_snapshot" released by "delete_snapshot" :: held 1.729s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:39:40 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "cinder-d07b576d-ea5e-4361-97c1-23c1341749cf-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:39:40 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-d07b576d-ea5e-4361-97c1-23c1341749cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:39:40 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "cinder-quobyte-f3b361bc-0654-42e5-8107-0a0b274e80e6" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:39:40 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-quobyte-f3b361bc-0654-42e5-8107-0a0b274e80e6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:39:40 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "cinder-quobyte-d07b576d-ea5e-4361-97c1-23c1341749cf" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:39:40 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-quobyte-d07b576d-ea5e-4361-97c1-23c1341749cf" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:39:40 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Deleting offline snapshot d07b576d-ea5e-4361-97c1-23c1341749cf of volume f3b361bc-0654-42e5-8107-0a0b274e80e6 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:39:40 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] snapshot_file for this snap is: volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:39:40 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba37c92-6baa-402e-bf64-9488c5631c13]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:39:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:41 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf Nov 06 14:39:41 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:41 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf" returned: 0 in 0.380s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:41 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3b361bc-0654-42e5-8107-0a0b274e80e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:39:41 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcccedd-8552-44e1-ae92-5488c49130a8]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:39:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:41 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6 Nov 06 14:39:41 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:41 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6" returned: 0 in 0.387s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:41 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf Nov 06 14:39:41 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:41 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:39:41 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Flow 'volume_create_manager' (72563c4c-54c1-4245-90d7-a74c28dd9790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:39:41 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eace3c5c-1fc8-49a3-987f-c6596d029e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:41 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eace3c5c-1fc8-49a3-987f-c6596d029e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-408406343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59385d73-527b-4cd0-82bb-c32fce5dfba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d81381e74ae84b3e8ad74c6cb5ea1597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:39:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:39:42Z,use_quota=True,user_id='687dc53fefa84ee29f1c92ed3c1ad96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:41 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2681ea5d-1d12-4e8c-833e-69df7b0f1a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:41 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2681ea5d-1d12-4e8c-833e-69df7b0f1a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:41 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e3878da-cdb8-4780-97b8-dfa9dc628c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:41 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e3878da-cdb8-4780-97b8-dfa9dc628c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59385d73-527b-4cd0-82bb-c32fce5dfba2', 'volume_name': 'volume-59385d73-527b-4cd0-82bb-c32fce5dfba2', 'volume_size': 2}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:41 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (453af988-5683-4069-9b09-b3264a1797e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:41 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (453af988-5683-4069-9b09-b3264a1797e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:41 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ce6803-bf40-4439-8b5f-7296acc4f874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:41 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Volume 59385d73-527b-4cd0-82bb-c32fce5dfba2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59385d73-527b-4cd0-82bb-c32fce5dfba2', 'volume_size': 2} Nov 06 14:39:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:39:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:39:41 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-408406343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59385d73-527b-4cd0-82bb-c32fce5dfba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d81381e74ae84b3e8ad74c6cb5ea1597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:39:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:39:42Z,use_quota=True,user_id='687dc53fefa84ee29f1c92ed3c1ad96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:39:41 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Creating volume 59385d73-527b-4cd0-82bb-c32fce5dfba2 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:39:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:39:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:39:41 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:39:41 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:39:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:39:41 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:39:41 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:39:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-59385d73-527b-4cd0-82bb-c32fce5dfba2 2147483648 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:41 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-59385d73-527b-4cd0-82bb-c32fce5dfba2 2147483648 Nov 06 14:39:41 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:42 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf" returned: 0 in 0.346s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:42 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf Nov 06 14:39:42 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:42 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6.d07b576d-ea5e-4361-97c1-23c1341749cf" returned: 0 in 0.252s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:42 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-quobyte-d07b576d-ea5e-4361-97c1-23c1341749cf" released by "_delete_snapshot" :: held 1.485s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:39:42 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-quobyte-f3b361bc-0654-42e5-8107-0a0b274e80e6" released by "delete_snapshot" :: held 1.508s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:39:42 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-59385d73-527b-4cd0-82bb-c32fce5dfba2 2147483648" returned: 0 in 0.488s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:42 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Created reservations ['9dafdbb8-fc3f-4253-9574-506e30d590a8', 'f083919e-9079-4100-aad9-808be4314dcb', 'c13d97f2-b7ed-4f32-8ddb-cb78abbd9237', '0d52d219-a34e-490b-92b8-8c9e7123a2b8'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:39:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-59385d73-527b-4cd0-82bb-c32fce5dfba2 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:42 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-59385d73-527b-4cd0-82bb-c32fce5dfba2 Nov 06 14:39:42 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:42 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Delete snapshot completed successfully. Nov 06 14:39:42 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-d07b576d-ea5e-4361-97c1-23c1341749cf-delete_snapshot" released by "delete_snapshot" :: held 1.681s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:39:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Snapshots deleted, issuing volume delete {{(pid=86854) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 06 14:39:42 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "cinder-quobyte-f3b361bc-0654-42e5-8107-0a0b274e80e6" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:39:42 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-quobyte-f3b361bc-0654-42e5-8107-0a0b274e80e6" acquired by "delete_volume" :: waited 0.016s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:39:42 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[361d2db4-07ff-47d1-91ac-b732bea2e64c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:39:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:42 devstack sudo[100946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6 Nov 06 14:39:42 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:42 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-59385d73-527b-4cd0-82bb-c32fce5dfba2" returned: 0 in 0.249s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:42 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:39:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:39:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ce6803-bf40-4439-8b5f-7296acc4f874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59385d73-527b-4cd0-82bb-c32fce5dfba2', 'volume_size': 2}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47859d79-7721-47d0-9d1d-428e9a31b72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:42 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Volume volume-59385d73-527b-4cd0-82bb-c32fce5dfba2 (59385d73-527b-4cd0-82bb-c32fce5dfba2): created successfully Nov 06 14:39:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47859d79-7721-47d0-9d1d-428e9a31b72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:42 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Flow 'volume_create_manager' (72563c4c-54c1-4245-90d7-a74c28dd9790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:39:42 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-aa5d8e11-276f-4296-a238-3e1c55f909df tempest-VolumesCloneNegativeTest-1023033821 None] Created volume successfully. Nov 06 14:39:42 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6" returned: 0 in 0.368s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:42 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6 Nov 06 14:39:42 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:43 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f3b361bc-0654-42e5-8107-0a0b274e80e6" returned: 0 in 0.244s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-quobyte-f3b361bc-0654-42e5-8107-0a0b274e80e6" released by "delete_volume" :: held 0.670s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:39:43 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Created reservations ['6c9621c8-5105-4d55-946d-92e68031e84a', '818142d1-2997-44e4-9cc8-2939b2d692d8', '443a2130-c8ff-45e0-ace6-8d53ff1159e1', '193ea1ec-cf52-4c93-9c80-1f85ba802611'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:39:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:39:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:39:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:39:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:39:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:39:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:43 devstack sudo[100955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:39:43 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:43 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.259s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:43 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:39:43 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Deleted volume successfully. Nov 06 14:39:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d2131d17-291d-4411-9b0f-517f8325e0f7 tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-f3b361bc-0654-42e5-8107-0a0b274e80e6-delete_volume" released by "delete_volume" :: held 4.593s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-99041cfc-161f-4c2d-850e-79fac1d6228f tempest-VolumesCloneNegativeTest-1023033821 None] Acquiring lock "cinder-59385d73-527b-4cd0-82bb-c32fce5dfba2-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Flow 'volume_create_manager' (dd8a5f46-ac0b-4481-9ef2-c2bf6c088e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd3d49c9-0b37-48f1-9eb9-f96ed73943eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-99041cfc-161f-4c2d-850e-79fac1d6228f tempest-VolumesCloneNegativeTest-1023033821 None] Lock "cinder-59385d73-527b-4cd0-82bb-c32fce5dfba2-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd3d49c9-0b37-48f1-9eb9-f96ed73943eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1243487310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb9c13fa-d404-4331-b33b-80a4f51b307b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd211e1e7dc4c4d9b52911950daedaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:39:44Z,use_quota=True,user_id='df928e0051e345cf9a46dfe9f7b1d5e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ee1728-c351-46b0-bb79-ea3204766443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ee1728-c351-46b0-bb79-ea3204766443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4c261b-1f91-4a7c-82c6-045471eea9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4c261b-1f91-4a7c-82c6-045471eea9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb9c13fa-d404-4331-b33b-80a4f51b307b', 'volume_name': 'volume-fb9c13fa-d404-4331-b33b-80a4f51b307b', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1912613-cc5a-4290-9970-dd3ffbc7d3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1912613-cc5a-4290-9970-dd3ffbc7d3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f36c75-9f8a-461d-a0e9-7e5ff08e1e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:44 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Volume fb9c13fa-d404-4331-b33b-80a4f51b307b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb9c13fa-d404-4331-b33b-80a4f51b307b', 'volume_size': 1} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1243487310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb9c13fa-d404-4331-b33b-80a4f51b307b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd211e1e7dc4c4d9b52911950daedaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:39:44Z,use_quota=True,user_id='df928e0051e345cf9a46dfe9f7b1d5e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Creating volume fb9c13fa-d404-4331-b33b-80a4f51b307b {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:39:44 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:44 devstack sudo[100958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b 1073741824 Nov 06 14:39:44 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-99041cfc-161f-4c2d-850e-79fac1d6228f tempest-VolumesCloneNegativeTest-1023033821 None] Acquiring lock "cinder-quobyte-59385d73-527b-4cd0-82bb-c32fce5dfba2" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-99041cfc-161f-4c2d-850e-79fac1d6228f tempest-VolumesCloneNegativeTest-1023033821 None] Lock "cinder-quobyte-59385d73-527b-4cd0-82bb-c32fce5dfba2" acquired by "delete_volume" :: waited 0.016s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98bccad-b6cf-4b80-a27c-49d7faedf671]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-99041cfc-161f-4c2d-850e-79fac1d6228f tempest-VolumesCloneNegativeTest-1023033821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-59385d73-527b-4cd0-82bb-c32fce5dfba2 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:44 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-59385d73-527b-4cd0-82bb-c32fce5dfba2 Nov 06 14:39:44 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:44 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b 1073741824" returned: 0 in 0.433s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:44 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-99041cfc-161f-4c2d-850e-79fac1d6228f tempest-VolumesCloneNegativeTest-1023033821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-59385d73-527b-4cd0-82bb-c32fce5dfba2" returned: 0 in 0.362s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-99041cfc-161f-4c2d-850e-79fac1d6228f tempest-VolumesCloneNegativeTest-1023033821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-59385d73-527b-4cd0-82bb-c32fce5dfba2 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:44 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-59385d73-527b-4cd0-82bb-c32fce5dfba2 Nov 06 14:39:44 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:44 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b Nov 06 14:39:44 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:44 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-99041cfc-161f-4c2d-850e-79fac1d6228f tempest-VolumesCloneNegativeTest-1023033821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-59385d73-527b-4cd0-82bb-c32fce5dfba2" returned: 0 in 0.256s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:44 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-99041cfc-161f-4c2d-850e-79fac1d6228f tempest-VolumesCloneNegativeTest-1023033821 None] Lock "cinder-quobyte-59385d73-527b-4cd0-82bb-c32fce5dfba2" released by "delete_volume" :: held 0.671s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b" returned: 0 in 0.260s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f36c75-9f8a-461d-a0e9-7e5ff08e1e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb9c13fa-d404-4331-b33b-80a4f51b307b', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad59b551-fbe3-4587-8244-75cbc22d0e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:44 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Volume volume-fb9c13fa-d404-4331-b33b-80a4f51b307b (fb9c13fa-d404-4331-b33b-80a4f51b307b): created successfully Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad59b551-fbe3-4587-8244-75cbc22d0e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Flow 'volume_create_manager' (dd8a5f46-ac0b-4481-9ef2-c2bf6c088e59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:39:44 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-feb487e0-7d5d-4037-ab3b-5f4dc7a81d9f tempest-VolumesDeleteCascade-1298520909 None] Created volume successfully. Nov 06 14:39:44 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-99041cfc-161f-4c2d-850e-79fac1d6228f tempest-VolumesCloneNegativeTest-1023033821 None] Created reservations ['38ecd689-ade2-4a87-8240-945ccc22e94a', '22e0f185-bf94-4cd9-b318-3a3e5107b470', 'a232cb9e-42f3-4473-9284-fedd80eddf09', '66dc36ea-871f-45a8-92d6-7547fcb45c55'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:39:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-99041cfc-161f-4c2d-850e-79fac1d6228f tempest-VolumesCloneNegativeTest-1023033821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:39:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-99041cfc-161f-4c2d-850e-79fac1d6228f tempest-VolumesCloneNegativeTest-1023033821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:39:45 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-99041cfc-161f-4c2d-850e-79fac1d6228f tempest-VolumesCloneNegativeTest-1023033821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:39:45 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-99041cfc-161f-4c2d-850e-79fac1d6228f tempest-VolumesCloneNegativeTest-1023033821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:39:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-99041cfc-161f-4c2d-850e-79fac1d6228f tempest-VolumesCloneNegativeTest-1023033821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:39:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-99041cfc-161f-4c2d-850e-79fac1d6228f tempest-VolumesCloneNegativeTest-1023033821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:45 devstack sudo[100974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:39:45 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6c4dd9d7-4243-40f2-b58f-992b799e6e77 tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:39:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6c4dd9d7-4243-40f2-b58f-992b799e6e77 tempest-VolumesDeleteCascade-1298520909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:39:45 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-6c4dd9d7-4243-40f2-b58f-992b799e6e77 tempest-VolumesDeleteCascade-1298520909 None] Creating offline snapshot c4736172-6e0b-4157-9dd1-487d7bbb5444 of volume fb9c13fa-d404-4331-b33b-80a4f51b307b {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:39:45 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0bdbb3-ab51-47b7-82f2-61a67ad40dfe]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:39:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6c4dd9d7-4243-40f2-b58f-992b799e6e77 tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:45 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-99041cfc-161f-4c2d-850e-79fac1d6228f tempest-VolumesCloneNegativeTest-1023033821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.294s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:45 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-99041cfc-161f-4c2d-850e-79fac1d6228f tempest-VolumesCloneNegativeTest-1023033821 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:39:45 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-99041cfc-161f-4c2d-850e-79fac1d6228f tempest-VolumesCloneNegativeTest-1023033821 None] Deleted volume successfully. Nov 06 14:39:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-99041cfc-161f-4c2d-850e-79fac1d6228f tempest-VolumesCloneNegativeTest-1023033821 None] Lock "cinder-59385d73-527b-4cd0-82bb-c32fce5dfba2-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:39:45 devstack sudo[100976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b Nov 06 14:39:45 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:45 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6c4dd9d7-4243-40f2-b58f-992b799e6e77 tempest-VolumesDeleteCascade-1298520909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b" returned: 0 in 0.420s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6c4dd9d7-4243-40f2-b58f-992b799e6e77 tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.c4736172-6e0b-4157-9dd1-487d7bbb5444 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:45 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.c4736172-6e0b-4157-9dd1-487d7bbb5444 1G Nov 06 14:39:45 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:46 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6c4dd9d7-4243-40f2-b58f-992b799e6e77 tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.c4736172-6e0b-4157-9dd1-487d7bbb5444 1G" returned: 0 in 0.429s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6c4dd9d7-4243-40f2-b58f-992b799e6e77 tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb9c13fa-d404-4331-b33b-80a4f51b307b -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.c4736172-6e0b-4157-9dd1-487d7bbb5444 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:46 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb9c13fa-d404-4331-b33b-80a4f51b307b -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.c4736172-6e0b-4157-9dd1-487d7bbb5444 Nov 06 14:39:46 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:46 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6c4dd9d7-4243-40f2-b58f-992b799e6e77 tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb9c13fa-d404-4331-b33b-80a4f51b307b -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.c4736172-6e0b-4157-9dd1-487d7bbb5444" returned: 0 in 0.314s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:46 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-6c4dd9d7-4243-40f2-b58f-992b799e6e77 tempest-VolumesDeleteCascade-1298520909 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.c4736172-6e0b-4157-9dd1-487d7bbb5444 is being set with open permissions: ugo+rw Nov 06 14:39:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6c4dd9d7-4243-40f2-b58f-992b799e6e77 tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.c4736172-6e0b-4157-9dd1-487d7bbb5444 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:46 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.c4736172-6e0b-4157-9dd1-487d7bbb5444 Nov 06 14:39:46 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:46 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6c4dd9d7-4243-40f2-b58f-992b799e6e77 tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.c4736172-6e0b-4157-9dd1-487d7bbb5444" returned: 0 in 0.249s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6c4dd9d7-4243-40f2-b58f-992b799e6e77 tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:46 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.info Nov 06 14:39:46 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:47 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6c4dd9d7-4243-40f2-b58f-992b799e6e77 tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.info" returned: 0 in 0.265s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:47 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-6c4dd9d7-4243-40f2-b58f-992b799e6e77 tempest-VolumesDeleteCascade-1298520909 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.info is being set with open permissions: ugo+rw Nov 06 14:39:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6c4dd9d7-4243-40f2-b58f-992b799e6e77 tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:47 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.info Nov 06 14:39:47 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:47 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6c4dd9d7-4243-40f2-b58f-992b799e6e77 tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.info" returned: 0 in 0.250s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6c4dd9d7-4243-40f2-b58f-992b799e6e77 tempest-VolumesDeleteCascade-1298520909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.033s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:39:47 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-6c4dd9d7-4243-40f2-b58f-992b799e6e77 tempest-VolumesDeleteCascade-1298520909 None] Create snapshot completed successfully Nov 06 14:39:48 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Flow 'volume_create_manager' (d7f4be3c-4789-449e-812a-d323e3704b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04322c2-8c8f-469d-b333-4906446539fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04322c2-8c8f-469d-b333-4906446539fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-93246361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0677468-1f94-4800-a90a-750ecb3d3139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb0512f24914b98b9d04d03bde66ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:39:49Z,use_quota=True,user_id='13e5fe376007495fa5c0bcecfa3c5e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac50b5c-d9ec-41c4-8cc6-9482bb07b3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac50b5c-d9ec-41c4-8cc6-9482bb07b3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63a92b90-365a-4407-97f5-c2f33d6374a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63a92b90-365a-4407-97f5-c2f33d6374a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0677468-1f94-4800-a90a-750ecb3d3139', 'volume_name': 'volume-e0677468-1f94-4800-a90a-750ecb3d3139', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfe8bf67-778c-45a6-b5ca-12eb0509806b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfe8bf67-778c-45a6-b5ca-12eb0509806b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22be5342-242f-4e55-b501-23843c85c7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:49 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Volume e0677468-1f94-4800-a90a-750ecb3d3139: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0677468-1f94-4800-a90a-750ecb3d3139', 'volume_size': 1} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-93246361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0677468-1f94-4800-a90a-750ecb3d3139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb0512f24914b98b9d04d03bde66ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:39:49Z,use_quota=True,user_id='13e5fe376007495fa5c0bcecfa3c5e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Creating volume e0677468-1f94-4800-a90a-750ecb3d3139 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:39:49 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0677468-1f94-4800-a90a-750ecb3d3139 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:49 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0677468-1f94-4800-a90a-750ecb3d3139 1073741824 Nov 06 14:39:49 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Flow 'volume_create_manager' (44967905-f5a4-4db1-aabd-16e80a93c4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61633ffe-c33f-4e40-b690-d1b30be7c29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61633ffe-c33f-4e40-b690-d1b30be7c29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1026686208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555bb4c9-facf-49ba-8227-3fc4946fca43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd211e1e7dc4c4d9b52911950daedaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c4736172-6e0b-4157-9dd1-487d7bbb5444,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:39:49Z,use_quota=True,user_id='df928e0051e345cf9a46dfe9f7b1d5e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23341fb9-0098-4887-9103-b59b01733b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23341fb9-0098-4887-9103-b59b01733b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2e8a273-fd87-4f69-8ef5-225f7af6ce6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2e8a273-fd87-4f69-8ef5-225f7af6ce6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '555bb4c9-facf-49ba-8227-3fc4946fca43', 'volume_name': 'volume-555bb4c9-facf-49ba-8227-3fc4946fca43', 'volume_size': 1, 'snapshot_id': 'c4736172-6e0b-4157-9dd1-487d7bbb5444'}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cb93f7c-e628-4d79-952f-c416d67d3d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cb93f7c-e628-4d79-952f-c416d67d3d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c316264-6c90-41e9-8099-a75a9585b937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:49 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Volume 555bb4c9-facf-49ba-8227-3fc4946fca43: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-555bb4c9-facf-49ba-8227-3fc4946fca43', 'volume_size': 1, 'snapshot_id': 'c4736172-6e0b-4157-9dd1-487d7bbb5444'} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:39:49 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0677468-1f94-4800-a90a-750ecb3d3139 1073741824" returned: 0 in 0.428s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0677468-1f94-4800-a90a-750ecb3d3139 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:49 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0677468-1f94-4800-a90a-750ecb3d3139 Nov 06 14:39:49 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:49 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0677468-1f94-4800-a90a-750ecb3d3139" returned: 0 in 0.237s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.567s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "cinder-quobyte-c4736172-6e0b-4157-9dd1-487d7bbb5444-555bb4c9-facf-49ba-8227-3fc4946fca43" by "_create_volume_from_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22be5342-242f-4e55-b501-23843c85c7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0677468-1f94-4800-a90a-750ecb3d3139', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7befce6-9b2b-420d-b662-9c323a5cde37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-quobyte-c4736172-6e0b-4157-9dd1-487d7bbb5444-555bb4c9-facf-49ba-8227-3fc4946fca43" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Creating volume 555bb4c9-facf-49ba-8227-3fc4946fca43 from snapshot c4736172-6e0b-4157-9dd1-487d7bbb5444 {{(pid=86854) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "cinder-quobyte-555bb4c9-facf-49ba-8227-3fc4946fca43" by "_copy_volume_from_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:39:49 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Volume volume-e0677468-1f94-4800-a90a-750ecb3d3139 (e0677468-1f94-4800-a90a-750ecb3d3139): created successfully Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7befce6-9b2b-420d-b662-9c323a5cde37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Flow 'volume_create_manager' (d7f4be3c-4789-449e-812a-d323e3704b54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-quobyte-555bb4c9-facf-49ba-8227-3fc4946fca43" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] snapshot: c4736172-6e0b-4157-9dd1-487d7bbb5444, volume: 555bb4c9-facf-49ba-8227-3fc4946fca43, {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 14:39:49 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-e4f139ce-82ea-44c7-8762-cbc118cc6689 tempest-VolumesNegativeTest-733549099 None] Created volume successfully. Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[776ed0f0-c5be-4ba8-8162-6f9856706874]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:39:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.c4736172-6e0b-4157-9dd1-487d7bbb5444 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:50 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.c4736172-6e0b-4157-9dd1-487d7bbb5444 Nov 06 14:39:50 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:50 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.c4736172-6e0b-4157-9dd1-487d7bbb5444" returned: 0 in 0.349s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:50 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb9c13fa-d404-4331-b33b-80a4f51b307b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:39:50 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd638072-cafc-4502-8916-ef17709e2f6f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:39:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:50 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b Nov 06 14:39:50 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:50 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b" returned: 0 in 0.356s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:50 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 14:39:50 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Creating direct copy from snapshot {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 14:39:50 devstack cinder-volume[86854]: DEBUG cinder.utils [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Path /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-555bb4c9-facf-49ba-8227-3fc4946fca43 not found in is_blk_device check {{(pid=86854) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 14:39:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-555bb4c9-facf-49ba-8227-3fc4946fca43 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:50 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-555bb4c9-facf-49ba-8227-3fc4946fca43 Nov 06 14:39:50 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:58 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-555bb4c9-facf-49ba-8227-3fc4946fca43" returned: 0 in 7.656s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:58 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Image conversion details: src /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b, size 1024.00 MB, duration 7.66 sec, destination /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-555bb4c9-facf-49ba-8227-3fc4946fca43 {{(pid=86854) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 14:39:58 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Converted 1024.00 MB image at 133.73 MB/s Nov 06 14:39:58 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-555bb4c9-facf-49ba-8227-3fc4946fca43 is being set with open permissions: ugo+rw Nov 06 14:39:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-555bb4c9-facf-49ba-8227-3fc4946fca43 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:39:58 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-555bb4c9-facf-49ba-8227-3fc4946fca43 Nov 06 14:39:58 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:39:58 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Nov 06 14:39:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-555bb4c9-facf-49ba-8227-3fc4946fca43" returned: 0 in 0.434s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:39:58 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-quobyte-555bb4c9-facf-49ba-8227-3fc4946fca43" released by "_copy_volume_from_snapshot" :: held 8.897s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:39:58 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-quobyte-c4736172-6e0b-4157-9dd1-487d7bbb5444-555bb4c9-facf-49ba-8227-3fc4946fca43" released by "_create_volume_from_snapshot" :: held 9.032s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:39:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.062s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:39:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c316264-6c90-41e9-8099-a75a9585b937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-555bb4c9-facf-49ba-8227-3fc4946fca43', 'volume_size': 1, 'snapshot_id': 'c4736172-6e0b-4157-9dd1-487d7bbb5444'}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5689b85e-3b89-4f4a-a8bd-7c8bed38ccb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:39:58 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Volume volume-555bb4c9-facf-49ba-8227-3fc4946fca43 (555bb4c9-facf-49ba-8227-3fc4946fca43): created successfully Nov 06 14:39:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5689b85e-3b89-4f4a-a8bd-7c8bed38ccb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:39:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Flow 'volume_create_manager' (44967905-f5a4-4db1-aabd-16e80a93c4c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:39:58 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-4c996f3f-683a-4202-b7cc-7dd24dfd74cc tempest-VolumesDeleteCascade-1298520909 None] Created volume successfully. Nov 06 14:40:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "cinder-fb9c13fa-d404-4331-b33b-80a4f51b307b-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:40:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-fb9c13fa-d404-4331-b33b-80a4f51b307b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:40:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Performing cascade delete. {{(pid=86854) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 06 14:40:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "cinder-c4736172-6e0b-4157-9dd1-487d7bbb5444-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:40:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-c4736172-6e0b-4157-9dd1-487d7bbb5444-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:40:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "cinder-quobyte-fb9c13fa-d404-4331-b33b-80a4f51b307b" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:40:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-quobyte-fb9c13fa-d404-4331-b33b-80a4f51b307b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:40:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "cinder-quobyte-c4736172-6e0b-4157-9dd1-487d7bbb5444" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:40:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-quobyte-c4736172-6e0b-4157-9dd1-487d7bbb5444" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:40:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Deleting offline snapshot c4736172-6e0b-4157-9dd1-487d7bbb5444 of volume fb9c13fa-d404-4331-b33b-80a4f51b307b {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:40:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] snapshot_file for this snap is: volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.c4736172-6e0b-4157-9dd1-487d7bbb5444 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:40:00 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0045f2-9daa-4762-8df6-c74ce75fcaf8]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:40:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.c4736172-6e0b-4157-9dd1-487d7bbb5444 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:00 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.c4736172-6e0b-4157-9dd1-487d7bbb5444 Nov 06 14:40:00 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:00 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.c4736172-6e0b-4157-9dd1-487d7bbb5444" returned: 0 in 0.385s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb9c13fa-d404-4331-b33b-80a4f51b307b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:40:00 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d644353-8a90-48c7-87d1-78451e88acd7]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:40:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:00 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b Nov 06 14:40:00 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:01 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b" returned: 0 in 0.565s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.c4736172-6e0b-4157-9dd1-487d7bbb5444 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:01 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.c4736172-6e0b-4157-9dd1-487d7bbb5444 Nov 06 14:40:01 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:01 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.c4736172-6e0b-4157-9dd1-487d7bbb5444" returned: 0 in 0.409s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.c4736172-6e0b-4157-9dd1-487d7bbb5444 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:01 devstack sudo[101149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.c4736172-6e0b-4157-9dd1-487d7bbb5444 Nov 06 14:40:01 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:02 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b.c4736172-6e0b-4157-9dd1-487d7bbb5444" returned: 0 in 0.304s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:02 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-quobyte-c4736172-6e0b-4157-9dd1-487d7bbb5444" released by "_delete_snapshot" :: held 1.821s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:40:02 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-quobyte-fb9c13fa-d404-4331-b33b-80a4f51b307b" released by "delete_snapshot" :: held 1.858s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:40:02 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Created reservations ['6872b81b-9720-4f66-a531-14747053705d', 'c6b2abf0-3819-4d8c-b31b-6ec747437ade', '0101f2f9-31d1-4480-b8ea-a9ac0eb8adb4', 'c82b3bec-8a53-4882-b845-ff66934126be'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:40:02 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Delete snapshot completed successfully. Nov 06 14:40:02 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-c4736172-6e0b-4157-9dd1-487d7bbb5444-delete_snapshot" released by "delete_snapshot" :: held 2.038s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:40:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Snapshots deleted, issuing volume delete {{(pid=86854) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 06 14:40:02 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "cinder-quobyte-fb9c13fa-d404-4331-b33b-80a4f51b307b" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:40:02 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-quobyte-fb9c13fa-d404-4331-b33b-80a4f51b307b" acquired by "delete_volume" :: waited 0.014s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:40:02 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ccc551-2167-437f-a045-13b181a7b39a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:40:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:02 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b Nov 06 14:40:02 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:02 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b" returned: 0 in 0.527s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:02 devstack sudo[101178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b Nov 06 14:40:02 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:03 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-fb9c13fa-d404-4331-b33b-80a4f51b307b" returned: 0 in 0.262s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:03 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-quobyte-fb9c13fa-d404-4331-b33b-80a4f51b307b" released by "delete_volume" :: held 0.874s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:40:03 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Created reservations ['8969a600-de7b-43d5-84e9-e20623684705', '73dbc321-7f1a-4564-b95d-5ef1d7be9631', 'bd2bc6cd-577d-4888-b0ac-f8baa0f1dede', '63f721de-37e8-4f99-8589-f84d8a8949ee'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:40:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:40:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:40:03 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:40:03 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:40:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:40:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:03 devstack sudo[101181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:40:03 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:03 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e5ad4541-c18f-48c1-b360-54d475d0de58 tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "cinder-555bb4c9-facf-49ba-8227-3fc4946fca43-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:40:03 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.370s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:03 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:40:03 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e5ad4541-c18f-48c1-b360-54d475d0de58 tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-555bb4c9-facf-49ba-8227-3fc4946fca43-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:40:03 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Deleted volume successfully. Nov 06 14:40:03 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f6beabff-2f55-4b4c-ae48-e36f7c4f2bad tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-fb9c13fa-d404-4331-b33b-80a4f51b307b-delete_volume" released by "delete_volume" :: held 3.626s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:40:03 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e5ad4541-c18f-48c1-b360-54d475d0de58 tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "cinder-quobyte-555bb4c9-facf-49ba-8227-3fc4946fca43" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:40:03 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e5ad4541-c18f-48c1-b360-54d475d0de58 tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-quobyte-555bb4c9-facf-49ba-8227-3fc4946fca43" acquired by "delete_volume" :: waited 0.016s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:40:03 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faed03f-a751-44eb-9a5a-652706c00349]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:40:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e5ad4541-c18f-48c1-b360-54d475d0de58 tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-555bb4c9-facf-49ba-8227-3fc4946fca43 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:03 devstack sudo[101186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-555bb4c9-facf-49ba-8227-3fc4946fca43 Nov 06 14:40:03 devstack sudo[101186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:04 devstack sudo[101186]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e5ad4541-c18f-48c1-b360-54d475d0de58 tempest-VolumesDeleteCascade-1298520909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-555bb4c9-facf-49ba-8227-3fc4946fca43" returned: 0 in 0.397s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e5ad4541-c18f-48c1-b360-54d475d0de58 tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-555bb4c9-facf-49ba-8227-3fc4946fca43 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:04 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-555bb4c9-facf-49ba-8227-3fc4946fca43 Nov 06 14:40:04 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:04 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e5ad4541-c18f-48c1-b360-54d475d0de58 tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-555bb4c9-facf-49ba-8227-3fc4946fca43" returned: 0 in 0.241s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:04 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e5ad4541-c18f-48c1-b360-54d475d0de58 tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-quobyte-555bb4c9-facf-49ba-8227-3fc4946fca43" released by "delete_volume" :: held 0.681s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:40:04 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-e5ad4541-c18f-48c1-b360-54d475d0de58 tempest-VolumesDeleteCascade-1298520909 None] Created reservations ['4129e537-de75-4de6-8d3c-5ac77a85492c', '69cb7272-9922-4da6-97d7-97f712d24d65', 'af6ef919-9ccf-48cc-9ac5-67bf1852e62c', 'fa4c3344-cf55-4af6-b793-bb987b040f09'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:40:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e5ad4541-c18f-48c1-b360-54d475d0de58 tempest-VolumesDeleteCascade-1298520909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:40:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e5ad4541-c18f-48c1-b360-54d475d0de58 tempest-VolumesDeleteCascade-1298520909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:40:04 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e5ad4541-c18f-48c1-b360-54d475d0de58 tempest-VolumesDeleteCascade-1298520909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:40:04 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e5ad4541-c18f-48c1-b360-54d475d0de58 tempest-VolumesDeleteCascade-1298520909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:40:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e5ad4541-c18f-48c1-b360-54d475d0de58 tempest-VolumesDeleteCascade-1298520909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:40:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e5ad4541-c18f-48c1-b360-54d475d0de58 tempest-VolumesDeleteCascade-1298520909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:04 devstack sudo[101194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:40:04 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:04 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e5ad4541-c18f-48c1-b360-54d475d0de58 tempest-VolumesDeleteCascade-1298520909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.257s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:04 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-e5ad4541-c18f-48c1-b360-54d475d0de58 tempest-VolumesDeleteCascade-1298520909 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:40:04 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-e5ad4541-c18f-48c1-b360-54d475d0de58 tempest-VolumesDeleteCascade-1298520909 None] Deleted volume successfully. Nov 06 14:40:04 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e5ad4541-c18f-48c1-b360-54d475d0de58 tempest-VolumesDeleteCascade-1298520909 None] Lock "cinder-555bb4c9-facf-49ba-8227-3fc4946fca43-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:40:08 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:40:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Flow 'volume_create_manager' (f71a43bf-fe9f-4ce3-8447-7a582cada4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:40:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (795fa86a-9603-4f73-aa62-8d0f1eaf52f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:40:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (795fa86a-9603-4f73-aa62-8d0f1eaf52f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-768839273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb738eac-7aae-452f-a460-d563497335d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='182944261fdc4a7b9db023a87cd6e8a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:40:08Z,use_quota=True,user_id='1f351d6b0ee5462db194980e183ccb29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:40:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d82bdc0-8d4b-4472-9d13-767e2423af40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:40:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d82bdc0-8d4b-4472-9d13-767e2423af40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:40:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1cd0f63-4447-4c0c-b74b-f1818727ffc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:40:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1cd0f63-4447-4c0c-b74b-f1818727ffc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb738eac-7aae-452f-a460-d563497335d3', 'volume_name': 'volume-bb738eac-7aae-452f-a460-d563497335d3', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:40:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b363a0-c522-4307-a0a1-fb14d44d089d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:40:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b363a0-c522-4307-a0a1-fb14d44d089d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:40:08 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4df70b0-6e17-4c2d-bf51-2fa22ff90df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:40:08 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Volume bb738eac-7aae-452f-a460-d563497335d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb738eac-7aae-452f-a460-d563497335d3', 'volume_size': 1} Nov 06 14:40:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:40:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:40:08 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-768839273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb738eac-7aae-452f-a460-d563497335d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='182944261fdc4a7b9db023a87cd6e8a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:40:08Z,use_quota=True,user_id='1f351d6b0ee5462db194980e183ccb29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:40:08 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Creating volume bb738eac-7aae-452f-a460-d563497335d3 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:40:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:40:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:40:08 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:40:08 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:40:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:40:08 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:40:08 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:40:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bb738eac-7aae-452f-a460-d563497335d3 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:08 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bb738eac-7aae-452f-a460-d563497335d3 1073741824 Nov 06 14:40:08 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:09 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bb738eac-7aae-452f-a460-d563497335d3 1073741824" returned: 0 in 0.451s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bb738eac-7aae-452f-a460-d563497335d3 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:09 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bb738eac-7aae-452f-a460-d563497335d3 Nov 06 14:40:09 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:09 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bb738eac-7aae-452f-a460-d563497335d3" returned: 0 in 0.256s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:40:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:40:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4df70b0-6e17-4c2d-bf51-2fa22ff90df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb738eac-7aae-452f-a460-d563497335d3', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:40:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe5768b-ab7a-43ce-b39c-50df000983d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:40:09 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Volume volume-bb738eac-7aae-452f-a460-d563497335d3 (bb738eac-7aae-452f-a460-d563497335d3): created successfully Nov 06 14:40:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe5768b-ab7a-43ce-b39c-50df000983d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:40:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Flow 'volume_create_manager' (f71a43bf-fe9f-4ce3-8447-7a582cada4f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:40:09 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-e159284f-4081-4fab-8b56-f514ffc482be tempest-VolumesMetadataTest-43424105 None] Created volume successfully. Nov 06 14:40:10 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2f992970-a2ed-4311-850b-6c9d40c05188 tempest-VolumesMetadataTest-43424105 None] Acquiring lock "cinder-bb738eac-7aae-452f-a460-d563497335d3-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:40:10 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2f992970-a2ed-4311-850b-6c9d40c05188 tempest-VolumesMetadataTest-43424105 None] Lock "cinder-bb738eac-7aae-452f-a460-d563497335d3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:40:10 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2f992970-a2ed-4311-850b-6c9d40c05188 tempest-VolumesMetadataTest-43424105 None] Acquiring lock "cinder-quobyte-bb738eac-7aae-452f-a460-d563497335d3" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:40:10 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2f992970-a2ed-4311-850b-6c9d40c05188 tempest-VolumesMetadataTest-43424105 None] Lock "cinder-quobyte-bb738eac-7aae-452f-a460-d563497335d3" acquired by "delete_volume" :: waited 0.023s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:40:10 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0aeb43-754b-4310-8670-cb0c0224e429]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:40:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2f992970-a2ed-4311-850b-6c9d40c05188 tempest-VolumesMetadataTest-43424105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bb738eac-7aae-452f-a460-d563497335d3 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:10 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bb738eac-7aae-452f-a460-d563497335d3 Nov 06 14:40:10 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:10 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2f992970-a2ed-4311-850b-6c9d40c05188 tempest-VolumesMetadataTest-43424105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bb738eac-7aae-452f-a460-d563497335d3" returned: 0 in 0.406s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2f992970-a2ed-4311-850b-6c9d40c05188 tempest-VolumesMetadataTest-43424105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bb738eac-7aae-452f-a460-d563497335d3 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:10 devstack sudo[101258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bb738eac-7aae-452f-a460-d563497335d3 Nov 06 14:40:10 devstack sudo[101258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:11 devstack sudo[101258]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2f992970-a2ed-4311-850b-6c9d40c05188 tempest-VolumesMetadataTest-43424105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-bb738eac-7aae-452f-a460-d563497335d3" returned: 0 in 0.261s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2f992970-a2ed-4311-850b-6c9d40c05188 tempest-VolumesMetadataTest-43424105 None] Lock "cinder-quobyte-bb738eac-7aae-452f-a460-d563497335d3" released by "delete_volume" :: held 0.730s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:40:11 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-2f992970-a2ed-4311-850b-6c9d40c05188 tempest-VolumesMetadataTest-43424105 None] Created reservations ['05c6bc9b-506f-4e68-9dfe-66c860c6e417', '1f17e9a3-3807-4ac2-9971-318422a83411', '8c44b719-deea-4848-bd32-adf608a81d44', '9818c113-07f1-4614-ac92-1aa05738ebae'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:40:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3cbd0488-5fa6-432d-92db-e75f1efcb21a tempest-VolumesNegativeTest-733549099 None] Acquiring lock "cinder-e0677468-1f94-4800-a90a-750ecb3d3139-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:40:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3cbd0488-5fa6-432d-92db-e75f1efcb21a tempest-VolumesNegativeTest-733549099 None] Lock "cinder-e0677468-1f94-4800-a90a-750ecb3d3139-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:40:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2f992970-a2ed-4311-850b-6c9d40c05188 tempest-VolumesMetadataTest-43424105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:40:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2f992970-a2ed-4311-850b-6c9d40c05188 tempest-VolumesMetadataTest-43424105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:40:11 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2f992970-a2ed-4311-850b-6c9d40c05188 tempest-VolumesMetadataTest-43424105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:40:11 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2f992970-a2ed-4311-850b-6c9d40c05188 tempest-VolumesMetadataTest-43424105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:40:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2f992970-a2ed-4311-850b-6c9d40c05188 tempest-VolumesMetadataTest-43424105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:40:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2f992970-a2ed-4311-850b-6c9d40c05188 tempest-VolumesMetadataTest-43424105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3cbd0488-5fa6-432d-92db-e75f1efcb21a tempest-VolumesNegativeTest-733549099 None] Acquiring lock "cinder-quobyte-e0677468-1f94-4800-a90a-750ecb3d3139" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:40:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3cbd0488-5fa6-432d-92db-e75f1efcb21a tempest-VolumesNegativeTest-733549099 None] Lock "cinder-quobyte-e0677468-1f94-4800-a90a-750ecb3d3139" acquired by "delete_volume" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:40:11 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:40:11 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:11 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c629ad-1fd4-43e1-ab0c-34833af6642f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:40:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3cbd0488-5fa6-432d-92db-e75f1efcb21a tempest-VolumesNegativeTest-733549099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0677468-1f94-4800-a90a-750ecb3d3139 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:11 devstack sudo[101263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0677468-1f94-4800-a90a-750ecb3d3139 Nov 06 14:40:11 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:11 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2f992970-a2ed-4311-850b-6c9d40c05188 tempest-VolumesMetadataTest-43424105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.264s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:11 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-2f992970-a2ed-4311-850b-6c9d40c05188 tempest-VolumesMetadataTest-43424105 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:40:11 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-2f992970-a2ed-4311-850b-6c9d40c05188 tempest-VolumesMetadataTest-43424105 None] Deleted volume successfully. Nov 06 14:40:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2f992970-a2ed-4311-850b-6c9d40c05188 tempest-VolumesMetadataTest-43424105 None] Lock "cinder-bb738eac-7aae-452f-a460-d563497335d3-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:40:11 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3cbd0488-5fa6-432d-92db-e75f1efcb21a tempest-VolumesNegativeTest-733549099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0677468-1f94-4800-a90a-750ecb3d3139" returned: 0 in 0.393s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3cbd0488-5fa6-432d-92db-e75f1efcb21a tempest-VolumesNegativeTest-733549099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0677468-1f94-4800-a90a-750ecb3d3139 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:11 devstack sudo[101269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0677468-1f94-4800-a90a-750ecb3d3139 Nov 06 14:40:11 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:12 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3cbd0488-5fa6-432d-92db-e75f1efcb21a tempest-VolumesNegativeTest-733549099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0677468-1f94-4800-a90a-750ecb3d3139" returned: 0 in 0.260s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:12 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3cbd0488-5fa6-432d-92db-e75f1efcb21a tempest-VolumesNegativeTest-733549099 None] Lock "cinder-quobyte-e0677468-1f94-4800-a90a-750ecb3d3139" released by "delete_volume" :: held 0.695s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:40:12 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=89,cinder:UPDATE=102,cinder:INSERT=21,cinder:DELETE=7 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:40:12 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-3cbd0488-5fa6-432d-92db-e75f1efcb21a tempest-VolumesNegativeTest-733549099 None] Created reservations ['15c23a03-6672-41cb-ad66-7bbf5ac172a7', '5111116d-0bee-4f3f-a75b-5b5aab72ff36', 'a9234bad-c714-4a7b-a39d-245190850565', 'ae2e8f69-eabc-4065-ae4b-f2890699aac1'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:40:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3cbd0488-5fa6-432d-92db-e75f1efcb21a tempest-VolumesNegativeTest-733549099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:40:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3cbd0488-5fa6-432d-92db-e75f1efcb21a tempest-VolumesNegativeTest-733549099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:40:12 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3cbd0488-5fa6-432d-92db-e75f1efcb21a tempest-VolumesNegativeTest-733549099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:40:12 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3cbd0488-5fa6-432d-92db-e75f1efcb21a tempest-VolumesNegativeTest-733549099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:40:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3cbd0488-5fa6-432d-92db-e75f1efcb21a tempest-VolumesNegativeTest-733549099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:40:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3cbd0488-5fa6-432d-92db-e75f1efcb21a tempest-VolumesNegativeTest-733549099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:12 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:40:12 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:12 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3cbd0488-5fa6-432d-92db-e75f1efcb21a tempest-VolumesNegativeTest-733549099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.292s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:12 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-3cbd0488-5fa6-432d-92db-e75f1efcb21a tempest-VolumesNegativeTest-733549099 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:40:12 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-3cbd0488-5fa6-432d-92db-e75f1efcb21a tempest-VolumesNegativeTest-733549099 None] Deleted volume successfully. Nov 06 14:40:12 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3cbd0488-5fa6-432d-92db-e75f1efcb21a tempest-VolumesNegativeTest-733549099 None] Lock "cinder-e0677468-1f94-4800-a90a-750ecb3d3139-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Flow 'volume_create_manager' (19c7c13a-6797-4f8c-9b97-c150c0267181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145a544f-a876-425d-8d09-ac03af8d468e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145a544f-a876-425d-8d09-ac03af8d468e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1090633033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60b9fecd-17af-4edf-8276-fc8a0840054e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3efa904dbabf43b787d3c8795757ce4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:40:16Z,use_quota=True,user_id='2f01a7d2606a4c6d8684734a93307f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b19c2eb2-3765-411c-8ac2-fa967ea6c10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b19c2eb2-3765-411c-8ac2-fa967ea6c10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ea7200-51b6-4176-b3b4-4ef776551b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ea7200-51b6-4176-b3b4-4ef776551b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60b9fecd-17af-4edf-8276-fc8a0840054e', 'volume_name': 'volume-60b9fecd-17af-4edf-8276-fc8a0840054e', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e2db92-2c34-41c2-9f67-ed1463d61746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e2db92-2c34-41c2-9f67-ed1463d61746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bbb307f-cb07-405d-8c0f-ed8232fecd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:40:15 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Volume 60b9fecd-17af-4edf-8276-fc8a0840054e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60b9fecd-17af-4edf-8276-fc8a0840054e', 'volume_size': 1} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1090633033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60b9fecd-17af-4edf-8276-fc8a0840054e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3efa904dbabf43b787d3c8795757ce4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:40:16Z,use_quota=True,user_id='2f01a7d2606a4c6d8684734a93307f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Creating volume 60b9fecd-17af-4edf-8276-fc8a0840054e {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:40:15 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:15 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e 1073741824 Nov 06 14:40:15 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Flow 'volume_create_manager' (5700c087-4f3f-428a-9350-944a88062a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (850b54cb-c939-4a4c-849d-24eff6734456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (850b54cb-c939-4a4c-849d-24eff6734456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-197150868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06a48fdb-6040-410c-b1f2-7ed089257652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f1a9926165f4c66ac428c1d28792c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:40:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:40:16Z,use_quota=True,user_id='b56f51e765c047d082d7341728da41ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e410afb-4878-46d2-bf3a-36b8b2b77e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e410afb-4878-46d2-bf3a-36b8b2b77e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906e5a5f-9691-44d8-aa12-1ca73330ed09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906e5a5f-9691-44d8-aa12-1ca73330ed09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06a48fdb-6040-410c-b1f2-7ed089257652', 'volume_name': 'volume-06a48fdb-6040-410c-b1f2-7ed089257652', 'volume_size': 2}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f59c0f-3caf-4d72-84cc-9ce5cf50789a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f59c0f-3caf-4d72-84cc-9ce5cf50789a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (375c28b2-0296-4d96-a2e4-e2003467057e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:40:15 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Volume 06a48fdb-6040-410c-b1f2-7ed089257652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06a48fdb-6040-410c-b1f2-7ed089257652', 'volume_size': 2} Nov 06 14:40:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:40:16 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e 1073741824" returned: 0 in 0.458s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:16 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=94,cinder:UPDATE=117,cinder:DELETE=11,cinder:INSERT=38 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:40:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:16 devstack sudo[101283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e Nov 06 14:40:16 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:16 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e" returned: 0 in 0.249s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:40:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:40:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.590s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:40:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-197150868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06a48fdb-6040-410c-b1f2-7ed089257652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f1a9926165f4c66ac428c1d28792c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:40:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:40:16Z,use_quota=True,user_id='b56f51e765c047d082d7341728da41ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:40:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Creating volume 06a48fdb-6040-410c-b1f2-7ed089257652 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:40:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:40:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:40:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:40:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:40:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:40:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:40:16 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:40:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652 2147483648 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:16 devstack sudo[101286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652 2147483648 Nov 06 14:40:16 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bbb307f-cb07-405d-8c0f-ed8232fecd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60b9fecd-17af-4edf-8276-fc8a0840054e', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:40:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (758b0dc7-6c88-49ae-bedf-83ff0a1f39a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:40:16 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Volume volume-60b9fecd-17af-4edf-8276-fc8a0840054e (60b9fecd-17af-4edf-8276-fc8a0840054e): created successfully Nov 06 14:40:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (758b0dc7-6c88-49ae-bedf-83ff0a1f39a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:40:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Flow 'volume_create_manager' (19c7c13a-6797-4f8c-9b97-c150c0267181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:40:16 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-2d73ad52-25e9-4028-9338-5d9a3a175d68 tempest-VolumesSnapshotListTestJSON-8035878 None] Created volume successfully. Nov 06 14:40:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-55abd085-0a4d-4a35-a389-744b17334ab3 tempest-VolumesSnapshotListTestJSON-8035878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:40:17 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652 2147483648" returned: 0 in 0.541s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:17 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652 Nov 06 14:40:17 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:17 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652" returned: 0 in 0.239s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:40:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:40:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-55abd085-0a4d-4a35-a389-744b17334ab3 tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.432s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:40:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (375c28b2-0296-4d96-a2e4-e2003467057e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06a48fdb-6040-410c-b1f2-7ed089257652', 'volume_size': 2}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:40:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65b52f8-c371-4567-8356-d29f579003f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:40:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-55abd085-0a4d-4a35-a389-744b17334ab3 tempest-VolumesSnapshotListTestJSON-8035878 None] Creating offline snapshot 8515e989-567c-44d2-a9f2-6b8be0adc937 of volume 60b9fecd-17af-4edf-8276-fc8a0840054e {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:40:17 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Volume volume-06a48fdb-6040-410c-b1f2-7ed089257652 (06a48fdb-6040-410c-b1f2-7ed089257652): created successfully Nov 06 14:40:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65b52f8-c371-4567-8356-d29f579003f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:40:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Flow 'volume_create_manager' (5700c087-4f3f-428a-9350-944a88062a0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:40:17 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8260d90-0244-4b5d-aadc-54c9379053ab]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:40:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-55abd085-0a4d-4a35-a389-744b17334ab3 tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:17 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-fce7605d-4ad5-4ac9-8984-4d854c57a08a tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Created volume successfully. Nov 06 14:40:17 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e Nov 06 14:40:17 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:17 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-55abd085-0a4d-4a35-a389-744b17334ab3 tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e" returned: 0 in 0.353s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-55abd085-0a4d-4a35-a389-744b17334ab3 tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:17 devstack sudo[101300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937 1G Nov 06 14:40:17 devstack sudo[101300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6b83b25f-7729-446b-857a-1e50f931c9bf tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:40:18 devstack sudo[101300]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-55abd085-0a4d-4a35-a389-744b17334ab3 tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937 1G" returned: 0 in 0.424s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-55abd085-0a4d-4a35-a389-744b17334ab3 tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60b9fecd-17af-4edf-8276-fc8a0840054e -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:18 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60b9fecd-17af-4edf-8276-fc8a0840054e -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937 Nov 06 14:40:18 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:18 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-55abd085-0a4d-4a35-a389-744b17334ab3 tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60b9fecd-17af-4edf-8276-fc8a0840054e -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937" returned: 0 in 0.287s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:18 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-55abd085-0a4d-4a35-a389-744b17334ab3 tempest-VolumesSnapshotListTestJSON-8035878 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937 is being set with open permissions: ugo+rw Nov 06 14:40:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-55abd085-0a4d-4a35-a389-744b17334ab3 tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:18 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937 Nov 06 14:40:18 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:18 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-55abd085-0a4d-4a35-a389-744b17334ab3 tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937" returned: 0 in 0.232s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-55abd085-0a4d-4a35-a389-744b17334ab3 tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:18 devstack sudo[101314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.info Nov 06 14:40:18 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:19 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-55abd085-0a4d-4a35-a389-744b17334ab3 tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.info" returned: 0 in 0.248s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:19 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-55abd085-0a4d-4a35-a389-744b17334ab3 tempest-VolumesSnapshotListTestJSON-8035878 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.info is being set with open permissions: ugo+rw Nov 06 14:40:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-55abd085-0a4d-4a35-a389-744b17334ab3 tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:19 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.info Nov 06 14:40:19 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:19 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-55abd085-0a4d-4a35-a389-744b17334ab3 tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.info" returned: 0 in 0.235s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-55abd085-0a4d-4a35-a389-744b17334ab3 tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.885s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:40:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6b83b25f-7729-446b-857a-1e50f931c9bf tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.098s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:40:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-6b83b25f-7729-446b-857a-1e50f931c9bf tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Creating offline snapshot 384e55e8-5211-43b5-9e1a-df28398ae15b of volume 06a48fdb-6040-410c-b1f2-7ed089257652 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:40:19 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-55abd085-0a4d-4a35-a389-744b17334ab3 tempest-VolumesSnapshotListTestJSON-8035878 None] Create snapshot completed successfully Nov 06 14:40:19 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3893d90-6990-480b-ae32-20311cf6bdf3]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:40:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6b83b25f-7729-446b-857a-1e50f931c9bf tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:19 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652 Nov 06 14:40:19 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:19 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6b83b25f-7729-446b-857a-1e50f931c9bf tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652" returned: 0 in 0.353s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6b83b25f-7729-446b-857a-1e50f931c9bf tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652.384e55e8-5211-43b5-9e1a-df28398ae15b 2G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:19 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652.384e55e8-5211-43b5-9e1a-df28398ae15b 2G Nov 06 14:40:19 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:20 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6b83b25f-7729-446b-857a-1e50f931c9bf tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652.384e55e8-5211-43b5-9e1a-df28398ae15b 2G" returned: 0 in 0.411s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6b83b25f-7729-446b-857a-1e50f931c9bf tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a48fdb-6040-410c-b1f2-7ed089257652 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652.384e55e8-5211-43b5-9e1a-df28398ae15b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:20 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a48fdb-6040-410c-b1f2-7ed089257652 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652.384e55e8-5211-43b5-9e1a-df28398ae15b Nov 06 14:40:20 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-10f3db2d-32d9-4e92-ab66-0337ecc8d6f8 tempest-VolumesSnapshotListTestJSON-8035878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:40:20 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6b83b25f-7729-446b-857a-1e50f931c9bf tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a48fdb-6040-410c-b1f2-7ed089257652 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652.384e55e8-5211-43b5-9e1a-df28398ae15b" returned: 0 in 0.292s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:20 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-6b83b25f-7729-446b-857a-1e50f931c9bf tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652.384e55e8-5211-43b5-9e1a-df28398ae15b is being set with open permissions: ugo+rw Nov 06 14:40:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6b83b25f-7729-446b-857a-1e50f931c9bf tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652.384e55e8-5211-43b5-9e1a-df28398ae15b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:20 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652.384e55e8-5211-43b5-9e1a-df28398ae15b Nov 06 14:40:20 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:20 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6b83b25f-7729-446b-857a-1e50f931c9bf tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652.384e55e8-5211-43b5-9e1a-df28398ae15b" returned: 0 in 0.246s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6b83b25f-7729-446b-857a-1e50f931c9bf tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:20 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652.info Nov 06 14:40:20 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:20 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6b83b25f-7729-446b-857a-1e50f931c9bf tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652.info" returned: 0 in 0.248s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:20 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-6b83b25f-7729-446b-857a-1e50f931c9bf tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652.info is being set with open permissions: ugo+rw Nov 06 14:40:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6b83b25f-7729-446b-857a-1e50f931c9bf tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:20 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652.info Nov 06 14:40:20 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:21 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6b83b25f-7729-446b-857a-1e50f931c9bf tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652.info" returned: 0 in 0.238s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6b83b25f-7729-446b-857a-1e50f931c9bf tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.885s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:40:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-10f3db2d-32d9-4e92-ab66-0337ecc8d6f8 tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.906s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:40:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-10f3db2d-32d9-4e92-ab66-0337ecc8d6f8 tempest-VolumesSnapshotListTestJSON-8035878 None] Creating offline snapshot 7172d879-2be1-4787-ac6c-24419697edec of volume 60b9fecd-17af-4edf-8276-fc8a0840054e {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:40:21 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-6b83b25f-7729-446b-857a-1e50f931c9bf tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Create snapshot completed successfully Nov 06 14:40:21 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcc3df0-ad8a-4f4a-b483-db36767473f3]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:40:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-10f3db2d-32d9-4e92-ab66-0337ecc8d6f8 tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:21 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937 Nov 06 14:40:21 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-526b37b6-9efc-4eb9-bf92-d0fcbafe441d tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Acquiring lock "cinder-384e55e8-5211-43b5-9e1a-df28398ae15b-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:40:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-526b37b6-9efc-4eb9-bf92-d0fcbafe441d tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Lock "cinder-384e55e8-5211-43b5-9e1a-df28398ae15b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:40:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-526b37b6-9efc-4eb9-bf92-d0fcbafe441d tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Acquiring lock "cinder-quobyte-06a48fdb-6040-410c-b1f2-7ed089257652" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:40:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-526b37b6-9efc-4eb9-bf92-d0fcbafe441d tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Lock "cinder-quobyte-06a48fdb-6040-410c-b1f2-7ed089257652" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:40:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-526b37b6-9efc-4eb9-bf92-d0fcbafe441d tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Acquiring lock "cinder-quobyte-384e55e8-5211-43b5-9e1a-df28398ae15b" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:40:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-526b37b6-9efc-4eb9-bf92-d0fcbafe441d tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Lock "cinder-quobyte-384e55e8-5211-43b5-9e1a-df28398ae15b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:40:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-526b37b6-9efc-4eb9-bf92-d0fcbafe441d tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Deleting offline snapshot 384e55e8-5211-43b5-9e1a-df28398ae15b of volume 06a48fdb-6040-410c-b1f2-7ed089257652 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:40:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-526b37b6-9efc-4eb9-bf92-d0fcbafe441d tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] snapshot_file for this snap is: volume-06a48fdb-6040-410c-b1f2-7ed089257652.384e55e8-5211-43b5-9e1a-df28398ae15b {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:40:21 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee1d9b2-3c28-4d17-acef-4a483e274bec]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:40:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-526b37b6-9efc-4eb9-bf92-d0fcbafe441d tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652.384e55e8-5211-43b5-9e1a-df28398ae15b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:21 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652.384e55e8-5211-43b5-9e1a-df28398ae15b Nov 06 14:40:21 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:21 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-10f3db2d-32d9-4e92-ab66-0337ecc8d6f8 tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937" returned: 0 in 0.390s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-10f3db2d-32d9-4e92-ab66-0337ecc8d6f8 tempest-VolumesSnapshotListTestJSON-8035878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60b9fecd-17af-4edf-8276-fc8a0840054e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:40:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-10f3db2d-32d9-4e92-ab66-0337ecc8d6f8 tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:21 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec 1G Nov 06 14:40:21 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:21 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-526b37b6-9efc-4eb9-bf92-d0fcbafe441d tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652.384e55e8-5211-43b5-9e1a-df28398ae15b" returned: 0 in 0.363s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-526b37b6-9efc-4eb9-bf92-d0fcbafe441d tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06a48fdb-6040-410c-b1f2-7ed089257652(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:40:21 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bfe822-5a2b-4501-ad40-ff2862ae5bb6]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:40:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-526b37b6-9efc-4eb9-bf92-d0fcbafe441d tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:22 devstack sudo[101361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652 Nov 06 14:40:22 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:22 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-10f3db2d-32d9-4e92-ab66-0337ecc8d6f8 tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec 1G" returned: 0 in 0.451s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-10f3db2d-32d9-4e92-ab66-0337ecc8d6f8 tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:22 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec Nov 06 14:40:22 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:22 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-526b37b6-9efc-4eb9-bf92-d0fcbafe441d tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652" returned: 0 in 0.367s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-526b37b6-9efc-4eb9-bf92-d0fcbafe441d tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652.384e55e8-5211-43b5-9e1a-df28398ae15b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:22 devstack sudo[101369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652.384e55e8-5211-43b5-9e1a-df28398ae15b Nov 06 14:40:22 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:22 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-10f3db2d-32d9-4e92-ab66-0337ecc8d6f8 tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec" returned: 0 in 0.294s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:22 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-10f3db2d-32d9-4e92-ab66-0337ecc8d6f8 tempest-VolumesSnapshotListTestJSON-8035878 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec is being set with open permissions: ugo+rw Nov 06 14:40:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-10f3db2d-32d9-4e92-ab66-0337ecc8d6f8 tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:22 devstack sudo[101374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec Nov 06 14:40:22 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:22 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-526b37b6-9efc-4eb9-bf92-d0fcbafe441d tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652.384e55e8-5211-43b5-9e1a-df28398ae15b" returned: 0 in 0.343s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-526b37b6-9efc-4eb9-bf92-d0fcbafe441d tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652.384e55e8-5211-43b5-9e1a-df28398ae15b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:22 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652.384e55e8-5211-43b5-9e1a-df28398ae15b Nov 06 14:40:22 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:22 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-10f3db2d-32d9-4e92-ab66-0337ecc8d6f8 tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec" returned: 0 in 0.258s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-10f3db2d-32d9-4e92-ab66-0337ecc8d6f8 tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.506s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:40:22 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-10f3db2d-32d9-4e92-ab66-0337ecc8d6f8 tempest-VolumesSnapshotListTestJSON-8035878 None] Create snapshot completed successfully Nov 06 14:40:22 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-526b37b6-9efc-4eb9-bf92-d0fcbafe441d tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652.384e55e8-5211-43b5-9e1a-df28398ae15b" returned: 0 in 0.248s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-526b37b6-9efc-4eb9-bf92-d0fcbafe441d tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Lock "cinder-quobyte-384e55e8-5211-43b5-9e1a-df28398ae15b" released by "_delete_snapshot" :: held 1.430s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:40:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-526b37b6-9efc-4eb9-bf92-d0fcbafe441d tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Lock "cinder-quobyte-06a48fdb-6040-410c-b1f2-7ed089257652" released by "delete_snapshot" :: held 1.452s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:40:22 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-526b37b6-9efc-4eb9-bf92-d0fcbafe441d tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Created reservations ['472094de-5d26-47e0-b000-5e7dbf41e49c', '28ead140-2918-4cc8-8238-46679db6f1fd', 'a13f8913-e3b8-495a-9109-85e0db24e771', '10404067-29a1-4ae4-bd34-6fcd4c008a8d'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:40:22 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-526b37b6-9efc-4eb9-bf92-d0fcbafe441d tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Delete snapshot completed successfully. Nov 06 14:40:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-526b37b6-9efc-4eb9-bf92-d0fcbafe441d tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Lock "cinder-384e55e8-5211-43b5-9e1a-df28398ae15b-delete_snapshot" released by "delete_snapshot" :: held 1.574s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:40:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:40:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:40:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:40:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:40:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:40:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:40:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:23 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:40:23 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:23 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.235s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:23 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:40:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager._thread_info {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:40:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread count: 28 {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 14:40:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread info: [<_MainThread(MainThread, started 130306900594816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 14:40:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-bc4044db-fa58-42a9-aa82-02b83ee1e04c tempest-VolumesSnapshotListTestJSON-8035878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:40:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-bc4044db-fa58-42a9-aa82-02b83ee1e04c tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:40:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-bc4044db-fa58-42a9-aa82-02b83ee1e04c tempest-VolumesSnapshotListTestJSON-8035878 None] Creating offline snapshot 07130167-12c5-4639-9a71-87c1b6457813 of volume 60b9fecd-17af-4edf-8276-fc8a0840054e {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:40:23 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a3bcca-950b-4e1c-8d91-9c3e9ef602b1]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:40:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bc4044db-fa58-42a9-aa82-02b83ee1e04c tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-75e9e1f9-ac0d-485c-be46-5abcf47ea0d9 tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Acquiring lock "cinder-06a48fdb-6040-410c-b1f2-7ed089257652-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:40:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-75e9e1f9-ac0d-485c-be46-5abcf47ea0d9 tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Lock "cinder-06a48fdb-6040-410c-b1f2-7ed089257652-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:40:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-75e9e1f9-ac0d-485c-be46-5abcf47ea0d9 tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Acquiring lock "cinder-quobyte-06a48fdb-6040-410c-b1f2-7ed089257652" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:40:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-75e9e1f9-ac0d-485c-be46-5abcf47ea0d9 tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Lock "cinder-quobyte-06a48fdb-6040-410c-b1f2-7ed089257652" acquired by "delete_volume" :: waited 0.018s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:40:23 devstack sudo[101386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec Nov 06 14:40:23 devstack sudo[101386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:23 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[795073ab-f6c8-4929-89b0-f5d983e37874]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:40:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-75e9e1f9-ac0d-485c-be46-5abcf47ea0d9 tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:23 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652 Nov 06 14:40:23 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:24 devstack sudo[101386]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bc4044db-fa58-42a9-aa82-02b83ee1e04c tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec" returned: 0 in 0.383s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-bc4044db-fa58-42a9-aa82-02b83ee1e04c tempest-VolumesSnapshotListTestJSON-8035878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60b9fecd-17af-4edf-8276-fc8a0840054e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:40:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bc4044db-fa58-42a9-aa82-02b83ee1e04c tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.07130167-12c5-4639-9a71-87c1b6457813 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:24 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.07130167-12c5-4639-9a71-87c1b6457813 1G Nov 06 14:40:24 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:24 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-75e9e1f9-ac0d-485c-be46-5abcf47ea0d9 tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652" returned: 0 in 0.372s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-75e9e1f9-ac0d-485c-be46-5abcf47ea0d9 tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:24 devstack sudo[101398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652 Nov 06 14:40:24 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:24 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-75e9e1f9-ac0d-485c-be46-5abcf47ea0d9 tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-06a48fdb-6040-410c-b1f2-7ed089257652" returned: 0 in 0.244s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:24 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-75e9e1f9-ac0d-485c-be46-5abcf47ea0d9 tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Lock "cinder-quobyte-06a48fdb-6040-410c-b1f2-7ed089257652" released by "delete_volume" :: held 0.692s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:40:24 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:24 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-75e9e1f9-ac0d-485c-be46-5abcf47ea0d9 tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Created reservations ['9a482799-0f34-4039-bb5c-e6ccabfad406', 'd8e82f89-7713-4ba9-833c-a4aa7741a7ab', '13136372-b893-46a1-a80e-ab8d7d347f86', '5a70cecf-c2bd-411c-84cd-7cc09558433f'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:40:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bc4044db-fa58-42a9-aa82-02b83ee1e04c tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.07130167-12c5-4639-9a71-87c1b6457813 1G" returned: 0 in 0.470s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bc4044db-fa58-42a9-aa82-02b83ee1e04c tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.07130167-12c5-4639-9a71-87c1b6457813 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:24 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.07130167-12c5-4639-9a71-87c1b6457813 Nov 06 14:40:24 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-75e9e1f9-ac0d-485c-be46-5abcf47ea0d9 tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:40:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-75e9e1f9-ac0d-485c-be46-5abcf47ea0d9 tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:40:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-75e9e1f9-ac0d-485c-be46-5abcf47ea0d9 tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:40:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-75e9e1f9-ac0d-485c-be46-5abcf47ea0d9 tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:40:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-75e9e1f9-ac0d-485c-be46-5abcf47ea0d9 tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:40:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-75e9e1f9-ac0d-485c-be46-5abcf47ea0d9 tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:24 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:40:24 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:24 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bc4044db-fa58-42a9-aa82-02b83ee1e04c tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.07130167-12c5-4639-9a71-87c1b6457813" returned: 0 in 0.331s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:24 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-bc4044db-fa58-42a9-aa82-02b83ee1e04c tempest-VolumesSnapshotListTestJSON-8035878 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.07130167-12c5-4639-9a71-87c1b6457813 is being set with open permissions: ugo+rw Nov 06 14:40:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bc4044db-fa58-42a9-aa82-02b83ee1e04c tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.07130167-12c5-4639-9a71-87c1b6457813 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:24 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-75e9e1f9-ac0d-485c-be46-5abcf47ea0d9 tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.262s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:24 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-75e9e1f9-ac0d-485c-be46-5abcf47ea0d9 tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:40:24 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-75e9e1f9-ac0d-485c-be46-5abcf47ea0d9 tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Deleted volume successfully. Nov 06 14:40:24 devstack sudo[101413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.07130167-12c5-4639-9a71-87c1b6457813 Nov 06 14:40:24 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:24 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-75e9e1f9-ac0d-485c-be46-5abcf47ea0d9 tempest-VolumesSnapshotNegativeTestJSON-1395205214 None] Lock "cinder-06a48fdb-6040-410c-b1f2-7ed089257652-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:40:25 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bc4044db-fa58-42a9-aa82-02b83ee1e04c tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.07130167-12c5-4639-9a71-87c1b6457813" returned: 0 in 0.261s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-bc4044db-fa58-42a9-aa82-02b83ee1e04c tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.550s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:40:25 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-bc4044db-fa58-42a9-aa82-02b83ee1e04c tempest-VolumesSnapshotListTestJSON-8035878 None] Create snapshot completed successfully Nov 06 14:40:26 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-82af8ebf-6b13-473a-957e-268b6acaf5be tempest-VolumesSnapshotListTestJSON-8035878 None] Acquiring lock "cinder-07130167-12c5-4639-9a71-87c1b6457813-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:40:26 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-82af8ebf-6b13-473a-957e-268b6acaf5be tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "cinder-07130167-12c5-4639-9a71-87c1b6457813-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:40:26 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-82af8ebf-6b13-473a-957e-268b6acaf5be tempest-VolumesSnapshotListTestJSON-8035878 None] Acquiring lock "cinder-quobyte-60b9fecd-17af-4edf-8276-fc8a0840054e" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:40:26 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-82af8ebf-6b13-473a-957e-268b6acaf5be tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "cinder-quobyte-60b9fecd-17af-4edf-8276-fc8a0840054e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:40:26 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-82af8ebf-6b13-473a-957e-268b6acaf5be tempest-VolumesSnapshotListTestJSON-8035878 None] Acquiring lock "cinder-quobyte-07130167-12c5-4639-9a71-87c1b6457813" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:40:26 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-82af8ebf-6b13-473a-957e-268b6acaf5be tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "cinder-quobyte-07130167-12c5-4639-9a71-87c1b6457813" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:40:26 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-82af8ebf-6b13-473a-957e-268b6acaf5be tempest-VolumesSnapshotListTestJSON-8035878 None] Deleting offline snapshot 07130167-12c5-4639-9a71-87c1b6457813 of volume 60b9fecd-17af-4edf-8276-fc8a0840054e {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:40:26 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-82af8ebf-6b13-473a-957e-268b6acaf5be tempest-VolumesSnapshotListTestJSON-8035878 None] snapshot_file for this snap is: volume-60b9fecd-17af-4edf-8276-fc8a0840054e.07130167-12c5-4639-9a71-87c1b6457813 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:40:26 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35abc2e-7714-4af4-a210-e0b541a72f97]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:40:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-82af8ebf-6b13-473a-957e-268b6acaf5be tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.07130167-12c5-4639-9a71-87c1b6457813 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:26 devstack sudo[101416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.07130167-12c5-4639-9a71-87c1b6457813 Nov 06 14:40:26 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:27 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-82af8ebf-6b13-473a-957e-268b6acaf5be tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.07130167-12c5-4639-9a71-87c1b6457813" returned: 0 in 0.373s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:27 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-82af8ebf-6b13-473a-957e-268b6acaf5be tempest-VolumesSnapshotListTestJSON-8035878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60b9fecd-17af-4edf-8276-fc8a0840054e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:40:27 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2683b3f-f6b3-4b8f-b714-cceaffa3c97e]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:40:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-82af8ebf-6b13-473a-957e-268b6acaf5be tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:27 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec Nov 06 14:40:27 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:27 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-82af8ebf-6b13-473a-957e-268b6acaf5be tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec" returned: 0 in 0.398s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:27 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-82af8ebf-6b13-473a-957e-268b6acaf5be tempest-VolumesSnapshotListTestJSON-8035878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60b9fecd-17af-4edf-8276-fc8a0840054e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:40:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-82af8ebf-6b13-473a-957e-268b6acaf5be tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.07130167-12c5-4639-9a71-87c1b6457813 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:27 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.07130167-12c5-4639-9a71-87c1b6457813 Nov 06 14:40:27 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:28 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-82af8ebf-6b13-473a-957e-268b6acaf5be tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.07130167-12c5-4639-9a71-87c1b6457813" returned: 0 in 0.482s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-82af8ebf-6b13-473a-957e-268b6acaf5be tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.07130167-12c5-4639-9a71-87c1b6457813 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:28 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.07130167-12c5-4639-9a71-87c1b6457813 Nov 06 14:40:28 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:28 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-82af8ebf-6b13-473a-957e-268b6acaf5be tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.07130167-12c5-4639-9a71-87c1b6457813" returned: 0 in 0.275s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-82af8ebf-6b13-473a-957e-268b6acaf5be tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "cinder-quobyte-07130167-12c5-4639-9a71-87c1b6457813" released by "_delete_snapshot" :: held 1.644s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:40:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-82af8ebf-6b13-473a-957e-268b6acaf5be tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "cinder-quobyte-60b9fecd-17af-4edf-8276-fc8a0840054e" released by "delete_snapshot" :: held 1.678s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:40:28 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-82af8ebf-6b13-473a-957e-268b6acaf5be tempest-VolumesSnapshotListTestJSON-8035878 None] Created reservations ['f6145466-b412-4fb0-b27e-cb0914594d96', '00113b76-f103-4e6a-b1ba-fb05a3043046', 'd96e7054-1d74-400c-a828-d707fe18e5e5', 'e3ede465-598a-40ce-85c5-cd6bec8c2fcc'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:40:28 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-82af8ebf-6b13-473a-957e-268b6acaf5be tempest-VolumesSnapshotListTestJSON-8035878 None] Delete snapshot completed successfully. Nov 06 14:40:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-82af8ebf-6b13-473a-957e-268b6acaf5be tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "cinder-07130167-12c5-4639-9a71-87c1b6457813-delete_snapshot" released by "delete_snapshot" :: held 1.836s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:40:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3cedac93-78b9-4ce1-982f-ddf71c6fbcf2 tempest-VolumesSnapshotListTestJSON-8035878 None] Acquiring lock "cinder-7172d879-2be1-4787-ac6c-24419697edec-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:40:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3cedac93-78b9-4ce1-982f-ddf71c6fbcf2 tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "cinder-7172d879-2be1-4787-ac6c-24419697edec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:40:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3cedac93-78b9-4ce1-982f-ddf71c6fbcf2 tempest-VolumesSnapshotListTestJSON-8035878 None] Acquiring lock "cinder-quobyte-60b9fecd-17af-4edf-8276-fc8a0840054e" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:40:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3cedac93-78b9-4ce1-982f-ddf71c6fbcf2 tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "cinder-quobyte-60b9fecd-17af-4edf-8276-fc8a0840054e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:40:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3cedac93-78b9-4ce1-982f-ddf71c6fbcf2 tempest-VolumesSnapshotListTestJSON-8035878 None] Acquiring lock "cinder-quobyte-7172d879-2be1-4787-ac6c-24419697edec" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:40:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3cedac93-78b9-4ce1-982f-ddf71c6fbcf2 tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "cinder-quobyte-7172d879-2be1-4787-ac6c-24419697edec" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:40:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-3cedac93-78b9-4ce1-982f-ddf71c6fbcf2 tempest-VolumesSnapshotListTestJSON-8035878 None] Deleting offline snapshot 7172d879-2be1-4787-ac6c-24419697edec of volume 60b9fecd-17af-4edf-8276-fc8a0840054e {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:40:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-3cedac93-78b9-4ce1-982f-ddf71c6fbcf2 tempest-VolumesSnapshotListTestJSON-8035878 None] snapshot_file for this snap is: volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:40:28 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[1186ce4b-5db8-41dd-a371-c2f3b12b3a26]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:40:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3cedac93-78b9-4ce1-982f-ddf71c6fbcf2 tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:29 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec Nov 06 14:40:29 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:29 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3cedac93-78b9-4ce1-982f-ddf71c6fbcf2 tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec" returned: 0 in 0.380s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:29 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-3cedac93-78b9-4ce1-982f-ddf71c6fbcf2 tempest-VolumesSnapshotListTestJSON-8035878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60b9fecd-17af-4edf-8276-fc8a0840054e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:40:29 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[900ffc73-780f-463b-858c-7955e42774a7]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:40:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3cedac93-78b9-4ce1-982f-ddf71c6fbcf2 tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:29 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937 Nov 06 14:40:29 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:29 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3cedac93-78b9-4ce1-982f-ddf71c6fbcf2 tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937" returned: 0 in 0.374s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:29 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-3cedac93-78b9-4ce1-982f-ddf71c6fbcf2 tempest-VolumesSnapshotListTestJSON-8035878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60b9fecd-17af-4edf-8276-fc8a0840054e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:40:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3cedac93-78b9-4ce1-982f-ddf71c6fbcf2 tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:29 devstack sudo[101452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec Nov 06 14:40:29 devstack sudo[101452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:30 devstack sudo[101452]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3cedac93-78b9-4ce1-982f-ddf71c6fbcf2 tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec" returned: 0 in 0.413s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3cedac93-78b9-4ce1-982f-ddf71c6fbcf2 tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:30 devstack sudo[101457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec Nov 06 14:40:30 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:30 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3cedac93-78b9-4ce1-982f-ddf71c6fbcf2 tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.7172d879-2be1-4787-ac6c-24419697edec" returned: 0 in 0.275s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3cedac93-78b9-4ce1-982f-ddf71c6fbcf2 tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "cinder-quobyte-7172d879-2be1-4787-ac6c-24419697edec" released by "_delete_snapshot" :: held 1.558s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:40:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3cedac93-78b9-4ce1-982f-ddf71c6fbcf2 tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "cinder-quobyte-60b9fecd-17af-4edf-8276-fc8a0840054e" released by "delete_snapshot" :: held 1.584s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:40:30 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-3cedac93-78b9-4ce1-982f-ddf71c6fbcf2 tempest-VolumesSnapshotListTestJSON-8035878 None] Created reservations ['58a26f8d-6218-4697-a48e-15ab4cddb127', '56f7e75e-cc05-482d-8967-77da0efbef1d', '79bf8428-6df1-4b81-bbc4-0a09f510bb5f', '152a877f-3f97-49db-926b-1b051f8ee387'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:40:30 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-3cedac93-78b9-4ce1-982f-ddf71c6fbcf2 tempest-VolumesSnapshotListTestJSON-8035878 None] Delete snapshot completed successfully. Nov 06 14:40:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3cedac93-78b9-4ce1-982f-ddf71c6fbcf2 tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "cinder-7172d879-2be1-4787-ac6c-24419697edec-delete_snapshot" released by "delete_snapshot" :: held 1.747s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:40:31 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b3b4ca89-7f73-4831-9980-57cb61d2fc26 tempest-VolumesSnapshotListTestJSON-8035878 None] Acquiring lock "cinder-8515e989-567c-44d2-a9f2-6b8be0adc937-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:40:31 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b3b4ca89-7f73-4831-9980-57cb61d2fc26 tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "cinder-8515e989-567c-44d2-a9f2-6b8be0adc937-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:40:31 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b3b4ca89-7f73-4831-9980-57cb61d2fc26 tempest-VolumesSnapshotListTestJSON-8035878 None] Acquiring lock "cinder-quobyte-60b9fecd-17af-4edf-8276-fc8a0840054e" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:40:31 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b3b4ca89-7f73-4831-9980-57cb61d2fc26 tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "cinder-quobyte-60b9fecd-17af-4edf-8276-fc8a0840054e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:40:31 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b3b4ca89-7f73-4831-9980-57cb61d2fc26 tempest-VolumesSnapshotListTestJSON-8035878 None] Acquiring lock "cinder-quobyte-8515e989-567c-44d2-a9f2-6b8be0adc937" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:40:31 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b3b4ca89-7f73-4831-9980-57cb61d2fc26 tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "cinder-quobyte-8515e989-567c-44d2-a9f2-6b8be0adc937" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:40:31 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-b3b4ca89-7f73-4831-9980-57cb61d2fc26 tempest-VolumesSnapshotListTestJSON-8035878 None] Deleting offline snapshot 8515e989-567c-44d2-a9f2-6b8be0adc937 of volume 60b9fecd-17af-4edf-8276-fc8a0840054e {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:40:31 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-b3b4ca89-7f73-4831-9980-57cb61d2fc26 tempest-VolumesSnapshotListTestJSON-8035878 None] snapshot_file for this snap is: volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:40:31 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[7845c1a5-4d9f-4a0a-a951-5616ed188c2d]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:40:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b3b4ca89-7f73-4831-9980-57cb61d2fc26 tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:31 devstack sudo[101460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937 Nov 06 14:40:31 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:31 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b3b4ca89-7f73-4831-9980-57cb61d2fc26 tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937" returned: 0 in 0.387s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:31 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-b3b4ca89-7f73-4831-9980-57cb61d2fc26 tempest-VolumesSnapshotListTestJSON-8035878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60b9fecd-17af-4edf-8276-fc8a0840054e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:40:31 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[8859d0d6-e3fd-4f19-a790-0cf1e34c74f9]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:40:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b3b4ca89-7f73-4831-9980-57cb61d2fc26 tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:31 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e Nov 06 14:40:31 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:31 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b3b4ca89-7f73-4831-9980-57cb61d2fc26 tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e" returned: 0 in 0.426s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b3b4ca89-7f73-4831-9980-57cb61d2fc26 tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:32 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937 Nov 06 14:40:32 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:32 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b3b4ca89-7f73-4831-9980-57cb61d2fc26 tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937" returned: 0 in 0.387s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b3b4ca89-7f73-4831-9980-57cb61d2fc26 tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:32 devstack sudo[101476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937 Nov 06 14:40:32 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:32 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b3b4ca89-7f73-4831-9980-57cb61d2fc26 tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e.8515e989-567c-44d2-a9f2-6b8be0adc937" returned: 0 in 0.266s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:32 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b3b4ca89-7f73-4831-9980-57cb61d2fc26 tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "cinder-quobyte-8515e989-567c-44d2-a9f2-6b8be0adc937" released by "_delete_snapshot" :: held 1.622s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:40:32 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b3b4ca89-7f73-4831-9980-57cb61d2fc26 tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "cinder-quobyte-60b9fecd-17af-4edf-8276-fc8a0840054e" released by "delete_snapshot" :: held 1.645s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:40:32 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-b3b4ca89-7f73-4831-9980-57cb61d2fc26 tempest-VolumesSnapshotListTestJSON-8035878 None] Created reservations ['1af6838d-ce34-4d84-9af6-adf1ce139538', '069ece8c-f5b3-4e21-ab82-98b870fc9119', 'ba5b191d-f02d-4293-b0da-9c1c800233e7', 'b5c873d2-ba74-4273-87d9-48259c2b9809'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:40:32 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-b3b4ca89-7f73-4831-9980-57cb61d2fc26 tempest-VolumesSnapshotListTestJSON-8035878 None] Delete snapshot completed successfully. Nov 06 14:40:32 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b3b4ca89-7f73-4831-9980-57cb61d2fc26 tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "cinder-8515e989-567c-44d2-a9f2-6b8be0adc937-delete_snapshot" released by "delete_snapshot" :: held 1.781s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:40:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ae3146ce-b03a-4476-a44b-cc641faf9c7b tempest-VolumesSnapshotListTestJSON-8035878 None] Acquiring lock "cinder-60b9fecd-17af-4edf-8276-fc8a0840054e-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:40:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ae3146ce-b03a-4476-a44b-cc641faf9c7b tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "cinder-60b9fecd-17af-4edf-8276-fc8a0840054e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:40:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ae3146ce-b03a-4476-a44b-cc641faf9c7b tempest-VolumesSnapshotListTestJSON-8035878 None] Acquiring lock "cinder-quobyte-60b9fecd-17af-4edf-8276-fc8a0840054e" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:40:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ae3146ce-b03a-4476-a44b-cc641faf9c7b tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "cinder-quobyte-60b9fecd-17af-4edf-8276-fc8a0840054e" acquired by "delete_volume" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:40:33 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cf47cc-2eb1-4a31-9176-cc35a4521599]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:40:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ae3146ce-b03a-4476-a44b-cc641faf9c7b tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:33 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e Nov 06 14:40:33 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:33 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ae3146ce-b03a-4476-a44b-cc641faf9c7b tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e" returned: 0 in 0.396s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ae3146ce-b03a-4476-a44b-cc641faf9c7b tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:33 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e Nov 06 14:40:33 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:34 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ae3146ce-b03a-4476-a44b-cc641faf9c7b tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-60b9fecd-17af-4edf-8276-fc8a0840054e" returned: 0 in 0.254s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:34 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ae3146ce-b03a-4476-a44b-cc641faf9c7b tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "cinder-quobyte-60b9fecd-17af-4edf-8276-fc8a0840054e" released by "delete_volume" :: held 0.731s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:40:34 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-ae3146ce-b03a-4476-a44b-cc641faf9c7b tempest-VolumesSnapshotListTestJSON-8035878 None] Created reservations ['1f9fd4f9-2d10-43d4-a22e-2c59b2dc36a8', '0386052f-4d17-43c6-a16b-f5004f289d65', '3a5f640a-1ed2-43db-b023-ef5ec30f67d8', 'bd004dc8-6e99-4608-9812-861a4f84dcad'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:40:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ae3146ce-b03a-4476-a44b-cc641faf9c7b tempest-VolumesSnapshotListTestJSON-8035878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:40:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ae3146ce-b03a-4476-a44b-cc641faf9c7b tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:40:34 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ae3146ce-b03a-4476-a44b-cc641faf9c7b tempest-VolumesSnapshotListTestJSON-8035878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:40:34 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ae3146ce-b03a-4476-a44b-cc641faf9c7b tempest-VolumesSnapshotListTestJSON-8035878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:40:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ae3146ce-b03a-4476-a44b-cc641faf9c7b tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:40:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ae3146ce-b03a-4476-a44b-cc641faf9c7b tempest-VolumesSnapshotListTestJSON-8035878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:34 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:40:34 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:34 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ae3146ce-b03a-4476-a44b-cc641faf9c7b tempest-VolumesSnapshotListTestJSON-8035878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.295s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:34 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-ae3146ce-b03a-4476-a44b-cc641faf9c7b tempest-VolumesSnapshotListTestJSON-8035878 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:40:34 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-ae3146ce-b03a-4476-a44b-cc641faf9c7b tempest-VolumesSnapshotListTestJSON-8035878 None] Deleted volume successfully. Nov 06 14:40:34 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ae3146ce-b03a-4476-a44b-cc641faf9c7b tempest-VolumesSnapshotListTestJSON-8035878 None] Lock "cinder-60b9fecd-17af-4edf-8276-fc8a0840054e-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:40:44 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:UPDATE=59,cinder:SELECT=46,cinder:DELETE=5,cinder:INSERT=11 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:40:44 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:UPDATE=46,cinder:DELETE=4,cinder:SELECT=46,cinder:INSERT=16 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:40:53 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:40:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Flow 'volume_create_manager' (fed4b7ba-2b45-49d2-b608-70d53097fd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:40:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef8e7ef-a14f-4e6e-bde3-2d9db4749b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:40:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef8e7ef-a14f-4e6e-bde3-2d9db4749b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-683343472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e78ceb-2416-42d0-bca1-69593c9c9218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e681623af7494d068c6ac50b6341cea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:40:54Z,use_quota=True,user_id='a88d08e1b5fa48d7852773df24ad1f3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:40:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b3844fe-d63c-420c-80a0-13c2aeb02469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:40:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b3844fe-d63c-420c-80a0-13c2aeb02469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:40:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a6eed55-c1d9-4492-b1a8-eb0415d00b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:40:54 devstack cinder-volume[86854]: DEBUG cinder.image.glance [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Creating Keystone auth plugin from conf {{(pid=86854) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 14:40:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a6eed55-c1d9-4492-b1a8-eb0415d00b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b1e78ceb-2416-42d0-bca1-69593c9c9218', 'volume_name': 'volume-b1e78ceb-2416-42d0-bca1-69593c9c9218', 'volume_size': 1, 'image_id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15767f46df214a0b8fce21735120de72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'created_at': datetime.datetime(2026, 11, 6, 13, 20, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 20, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0e99-e622-4342-8eb8-14122332c9ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:40:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5b85630-e488-4b6a-bc97-0374bf013492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:40:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5b85630-e488-4b6a-bc97-0374bf013492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:40:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c545ad7-fd3f-42a1-885d-27c0a5d8ef60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:40:54 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Volume b1e78ceb-2416-42d0-bca1-69593c9c9218: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b1e78ceb-2416-42d0-bca1-69593c9c9218', 'volume_size': 1, 'image_id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15767f46df214a0b8fce21735120de72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'created_at': datetime.datetime(2026, 11, 6, 13, 20, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 20, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0e99-e622-4342-8eb8-14122332c9ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 14:40:54 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Trying to clone b1e78ceb-2416-42d0-bca1-69593c9c9218 from image 918d0e99-e622-4342-8eb8-14122332c9ca at location (None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}]). {{(pid=86854) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 14:40:54 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_ku69r_btdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 14:40:54 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Image download 20.69 MB at 20.69 MB/s Nov 06 14:40:54 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61bfcc5-ec09-4237-9436-eb9eba015bef]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:40:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_ku69r_btdevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:55 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_ku69r_btdevstack@QuobyteHD Nov 06 14:40:55 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:55 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_ku69r_btdevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:55 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Temporary image 918d0e99-e622-4342-8eb8-14122332c9ca is fetched for user a88d08e1b5fa48d7852773df24ad1f3b. {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 14:40:55 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4abac0-4185-4efc-8bb5-c40216e176a4]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:40:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_ku69r_btdevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:55 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_ku69r_btdevstack@QuobyteHD Nov 06 14:40:55 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:55 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_ku69r_btdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:40:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:40:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-683343472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e78ceb-2416-42d0-bca1-69593c9c9218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e681623af7494d068c6ac50b6341cea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:40:54Z,use_quota=True,user_id='a88d08e1b5fa48d7852773df24ad1f3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:40:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Creating volume b1e78ceb-2416-42d0-bca1-69593c9c9218 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:40:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:40:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:40:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:40:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:40:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:40:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:40:55 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:40:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b1e78ceb-2416-42d0-bca1-69593c9c9218 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:55 devstack sudo[101506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b1e78ceb-2416-42d0-bca1-69593c9c9218 1073741824 Nov 06 14:40:55 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:56 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b1e78ceb-2416-42d0-bca1-69593c9c9218 1073741824" returned: 0 in 0.488s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b1e78ceb-2416-42d0-bca1-69593c9c9218 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:56 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b1e78ceb-2416-42d0-bca1-69593c9c9218 Nov 06 14:40:56 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:56 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b1e78ceb-2416-42d0-bca1-69593c9c9218" returned: 0 in 0.272s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:56 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:40:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:40:56 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Attempting download of 918d0e99-e622-4342-8eb8-14122332c9ca ((None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}])) to volume b1e78ceb-2416-42d0-bca1-69593c9c9218. {{(pid=86854) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 14:40:56 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbacdeae-b8c7-4427-accb-c783b4840d0a]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:40:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_68yjs56n {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:56 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_68yjs56n Nov 06 14:40:56 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:56 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_68yjs56n" returned: 0 in 0.331s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_68yjs56n {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:57 devstack sudo[101519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_68yjs56n Nov 06 14:40:57 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:57 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_68yjs56n" returned: 1 in 0.401s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0e99-e622-4342-8eb8-14122332c9ca_68yjs56n' failed. Not Retrying. {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 14:40:57 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[e806d3ad-3b58-4a9c-9bb9-a111643d0dfe]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:40:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_ku69r_btdevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:57 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_ku69r_btdevstack@QuobyteHD Nov 06 14:40:57 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:57 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_ku69r_btdevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:57 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] 918d0e99-e622-4342-8eb8-14122332c9ca was qcow2, converting to qcow2 {{(pid=86854) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 14:40:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_ku69r_btdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b1e78ceb-2416-42d0-bca1-69593c9c9218 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:57 devstack sudo[101530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_ku69r_btdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b1e78ceb-2416-42d0-bca1-69593c9c9218 Nov 06 14:40:57 devstack sudo[101530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:40:59 devstack sudo[101530]: pam_unix(sudo:session): session closed for user root Nov 06 14:40:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_ku69r_btdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b1e78ceb-2416-42d0-bca1-69593c9c9218" returned: 0 in 2.039s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:40:59 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_918d0e99-e622-4342-8eb8-14122332c9ca_ku69r_btdevstack@QuobyteHD, size 112.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b1e78ceb-2416-42d0-bca1-69593c9c9218 {{(pid=86854) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 14:40:59 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Converted 112.00 MB image at 54.87 MB/s Nov 06 14:40:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b1e78ceb-2416-42d0-bca1-69593c9c9218 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:40:59 devstack sudo[101539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b1e78ceb-2416-42d0-bca1-69593c9c9218 1G Nov 06 14:40:59 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:41:00 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root Nov 06 14:41:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b1e78ceb-2416-42d0-bca1-69593c9c9218 1G" returned: 0 in 0.334s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:41:00 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Downloaded image 918d0e99-e622-4342-8eb8-14122332c9ca ((None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}])) to volume b1e78ceb-2416-42d0-bca1-69593c9c9218 successfully. {{(pid=86854) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 14:41:00 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Temporary image 918d0e99-e622-4342-8eb8-14122332c9ca for user a88d08e1b5fa48d7852773df24ad1f3b is deleted. {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 14:41:00 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Marking volume b1e78ceb-2416-42d0-bca1-69593c9c9218 as bootable. {{(pid=86854) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 14:41:00 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Copying metadata from image 918d0e99-e622-4342-8eb8-14122332c9ca to b1e78ceb-2416-42d0-bca1-69593c9c9218. {{(pid=86854) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 14:41:00 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Creating volume glance metadata for volume b1e78ceb-2416-42d0-bca1-69593c9c9218 backed by image 918d0e99-e622-4342-8eb8-14122332c9ca with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86854) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 14:41:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c545ad7-fd3f-42a1-885d-27c0a5d8ef60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1e78ceb-2416-42d0-bca1-69593c9c9218', 'volume_size': 1, 'image_id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0e99-e622-4342-8eb8-14122332c9ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15767f46df214a0b8fce21735120de72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0e99-e622-4342-8eb8-14122332c9ca', 'created_at': datetime.datetime(2026, 11, 6, 13, 20, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 20, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0e99-e622-4342-8eb8-14122332c9ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:41:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3655ca1b-d10a-4518-8c45-737a2645b2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:41:00 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Volume volume-b1e78ceb-2416-42d0-bca1-69593c9c9218 (b1e78ceb-2416-42d0-bca1-69593c9c9218): created successfully Nov 06 14:41:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3655ca1b-d10a-4518-8c45-737a2645b2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:41:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Flow 'volume_create_manager' (fed4b7ba-2b45-49d2-b608-70d53097fd80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:41:00 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-89e42dcf-ea8a-4f09-96a3-13bbfab6760f tempest-TestShelveInstance-147598566 None] Created volume successfully. Nov 06 14:41:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-e3db944f-53de-473a-9bf2-086023710946 req-66871f50-6086-4d19-8910-b177e9400992 tempest-TestShelveInstance-147598566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:41:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-e3db944f-53de-473a-9bf2-086023710946 req-66871f50-6086-4d19-8910-b177e9400992 tempest-TestShelveInstance-147598566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:41:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-e3db944f-53de-473a-9bf2-086023710946 req-66871f50-6086-4d19-8910-b177e9400992 tempest-TestShelveInstance-147598566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:41:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-e3db944f-53de-473a-9bf2-086023710946 req-66871f50-6086-4d19-8910-b177e9400992 tempest-TestShelveInstance-147598566 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e', 'name': 'volume-b1e78ceb-2416-42d0-bca1-69593c9c9218', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '861fcef0-8803-4060-8341-5d5684c0f5f7', 'enforce_multipath': True} {{(pid=86854) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 14:41:04 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-e3db944f-53de-473a-9bf2-086023710946 req-66871f50-6086-4d19-8910-b177e9400992 tempest-TestShelveInstance-147598566 None] attachment_update completed successfully. Nov 06 14:41:16 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=19,cinder:UPDATE=6,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:41:16 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=14,cinder:UPDATE=7,cinder:INSERT=8 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:41:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:41:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:41:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:41:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:41:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:41:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:41:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:41:23 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:41:23 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:41:23 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Nov 06 14:41:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.247s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:41:23 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:41:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager._thread_info {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:41:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread count: 28 {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 14:41:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread info: [<_MainThread(MainThread, started 130306900594816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 14:41:30 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Flow 'volume_create_manager' (94c8dc93-920e-4223-859f-fd344b22c51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d0b731-fc68-4f25-81af-9b5e345b7824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d0b731-fc68-4f25-81af-9b5e345b7824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-605179075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=730683d4-7c66-4344-adc6-ffff2f35c0e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc012de9c6ee46f1a461eb166bc09ae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:41:31Z,use_quota=True,user_id='15d39aaf84c348c6bd835bee1c4c22f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c7ea11-86f8-4915-8c34-5a5894aa6afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c7ea11-86f8-4915-8c34-5a5894aa6afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e553aaf-5244-46f7-91c9-1f49ac616f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e553aaf-5244-46f7-91c9-1f49ac616f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '730683d4-7c66-4344-adc6-ffff2f35c0e4', 'volume_name': 'volume-730683d4-7c66-4344-adc6-ffff2f35c0e4', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2220aeb-511a-487f-b65d-e11575e69d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2220aeb-511a-487f-b65d-e11575e69d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (901fb536-d92b-4b5c-8173-e1580f88d11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:41:31 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Volume 730683d4-7c66-4344-adc6-ffff2f35c0e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-730683d4-7c66-4344-adc6-ffff2f35c0e4', 'volume_size': 1} Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-605179075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=730683d4-7c66-4344-adc6-ffff2f35c0e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc012de9c6ee46f1a461eb166bc09ae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:41:31Z,use_quota=True,user_id='15d39aaf84c348c6bd835bee1c4c22f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Creating volume 730683d4-7c66-4344-adc6-ffff2f35c0e4 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:41:31 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-730683d4-7c66-4344-adc6-ffff2f35c0e4 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:41:31 devstack sudo[102247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-730683d4-7c66-4344-adc6-ffff2f35c0e4 1073741824 Nov 06 14:41:31 devstack sudo[102247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:41:31 devstack sudo[102247]: pam_unix(sudo:session): session closed for user root Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-730683d4-7c66-4344-adc6-ffff2f35c0e4 1073741824" returned: 0 in 0.406s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-730683d4-7c66-4344-adc6-ffff2f35c0e4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:41:31 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-730683d4-7c66-4344-adc6-ffff2f35c0e4 Nov 06 14:41:31 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:41:31 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-730683d4-7c66-4344-adc6-ffff2f35c0e4" returned: 0 in 0.240s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (901fb536-d92b-4b5c-8173-e1580f88d11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-730683d4-7c66-4344-adc6-ffff2f35c0e4', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f621c62-72b1-4b86-94cb-13987cb2a446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:41:31 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Volume volume-730683d4-7c66-4344-adc6-ffff2f35c0e4 (730683d4-7c66-4344-adc6-ffff2f35c0e4): created successfully Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f621c62-72b1-4b86-94cb-13987cb2a446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:41:31 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Flow 'volume_create_manager' (94c8dc93-920e-4223-859f-fd344b22c51b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:41:31 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-9a92735b-07f4-4bed-85b4-5bd5c890e2ce tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Created volume successfully. Nov 06 14:41:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-82a51726-e128-42b1-83a2-bac26a989b62 req-e8c73bb0-616c-40f7-87dd-72f6ec1e8c3e tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:41:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-82a51726-e128-42b1-83a2-bac26a989b62 req-e8c73bb0-616c-40f7-87dd-72f6ec1e8c3e tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:41:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-82a51726-e128-42b1-83a2-bac26a989b62 req-e8c73bb0-616c-40f7-87dd-72f6ec1e8c3e tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:41:32 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-82a51726-e128-42b1-83a2-bac26a989b62 req-e8c73bb0-616c-40f7-87dd-72f6ec1e8c3e tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e', 'name': 'volume-730683d4-7c66-4344-adc6-ffff2f35c0e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b9f4f02-3862-4f82-bf30-6dc9f1590758', 'enforce_multipath': True} {{(pid=86854) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 14:41:32 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-82a51726-e128-42b1-83a2-bac26a989b62 req-e8c73bb0-616c-40f7-87dd-72f6ec1e8c3e tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] attachment_update completed successfully. Nov 06 14:41:34 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-9fd00a85-eed8-4668-ab84-f4812dc6b2d9 req-9b05d31e-71de-4300-81b8-a5d3214608c6 tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Terminate volume connection completed successfully. Nov 06 14:41:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-9fd00a85-eed8-4668-ab84-f4812dc6b2d9 req-9b05d31e-71de-4300-81b8-a5d3214608c6 tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Deleting attachment 3b9f4f02-3862-4f82-bf30-6dc9f1590758. {{(pid=86854) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 14:41:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-44ed8ecf-79ee-4cd4-aa87-555168dd414e tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Acquiring lock "cinder-730683d4-7c66-4344-adc6-ffff2f35c0e4-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:41:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-44ed8ecf-79ee-4cd4-aa87-555168dd414e tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Lock "cinder-730683d4-7c66-4344-adc6-ffff2f35c0e4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:41:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-44ed8ecf-79ee-4cd4-aa87-555168dd414e tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Acquiring lock "cinder-quobyte-730683d4-7c66-4344-adc6-ffff2f35c0e4" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:41:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-44ed8ecf-79ee-4cd4-aa87-555168dd414e tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Lock "cinder-quobyte-730683d4-7c66-4344-adc6-ffff2f35c0e4" acquired by "delete_volume" :: waited 0.014s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:41:35 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde6cb09-050f-41de-888b-3363a5a06eaa]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:41:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-44ed8ecf-79ee-4cd4-aa87-555168dd414e tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-730683d4-7c66-4344-adc6-ffff2f35c0e4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:41:35 devstack sudo[102279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-730683d4-7c66-4344-adc6-ffff2f35c0e4 Nov 06 14:41:35 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:41:36 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root Nov 06 14:41:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-44ed8ecf-79ee-4cd4-aa87-555168dd414e tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-730683d4-7c66-4344-adc6-ffff2f35c0e4" returned: 0 in 0.366s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:41:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-44ed8ecf-79ee-4cd4-aa87-555168dd414e tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-730683d4-7c66-4344-adc6-ffff2f35c0e4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:41:36 devstack sudo[102284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-730683d4-7c66-4344-adc6-ffff2f35c0e4 Nov 06 14:41:36 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:41:36 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root Nov 06 14:41:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-44ed8ecf-79ee-4cd4-aa87-555168dd414e tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-730683d4-7c66-4344-adc6-ffff2f35c0e4" returned: 0 in 0.249s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:41:36 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-44ed8ecf-79ee-4cd4-aa87-555168dd414e tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Lock "cinder-quobyte-730683d4-7c66-4344-adc6-ffff2f35c0e4" released by "delete_volume" :: held 0.654s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:41:36 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-44ed8ecf-79ee-4cd4-aa87-555168dd414e tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Created reservations ['7e705f80-86bb-430f-89a0-b1e751654eae', '87b2147f-73cf-44b8-aaea-0cb4f2988083', '4beebfd1-36ea-4316-be97-b90747991be6', '3a593198-f9c7-466f-8687-2a00f77e7e13'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:41:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-44ed8ecf-79ee-4cd4-aa87-555168dd414e tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:41:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-44ed8ecf-79ee-4cd4-aa87-555168dd414e tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:41:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-44ed8ecf-79ee-4cd4-aa87-555168dd414e tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:41:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-44ed8ecf-79ee-4cd4-aa87-555168dd414e tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:41:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-44ed8ecf-79ee-4cd4-aa87-555168dd414e tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:41:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-44ed8ecf-79ee-4cd4-aa87-555168dd414e tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:41:36 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:41:36 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:41:36 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Nov 06 14:41:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-44ed8ecf-79ee-4cd4-aa87-555168dd414e tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.248s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:41:36 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-44ed8ecf-79ee-4cd4-aa87-555168dd414e tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:41:36 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-44ed8ecf-79ee-4cd4-aa87-555168dd414e tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Deleted volume successfully. Nov 06 14:41:36 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-44ed8ecf-79ee-4cd4-aa87-555168dd414e tempest-TestServerVolumeAttachScenarioOldVersion-1501571979 None] Lock "cinder-730683d4-7c66-4344-adc6-ffff2f35c0e4-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:41:39 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-fe8e820e-a1cf-4201-8dd6-a595feed9035 req-ba68cfdd-a664-403c-98ea-646833eae0ba tempest-TestShelveInstance-147598566 None] Terminate volume connection completed successfully. Nov 06 14:41:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-fe8e820e-a1cf-4201-8dd6-a595feed9035 req-ba68cfdd-a664-403c-98ea-646833eae0ba tempest-TestShelveInstance-147598566 None] Deleting attachment 861fcef0-8803-4060-8341-5d5684c0f5f7. {{(pid=86854) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 14:41:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-89a884af-bf0f-4734-823a-cc29ed138cdd req-6c6fcc17-7b1d-42bb-8d0d-bba8a611239d tempest-TestShelveInstance-147598566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:41:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-89a884af-bf0f-4734-823a-cc29ed138cdd req-6c6fcc17-7b1d-42bb-8d0d-bba8a611239d tempest-TestShelveInstance-147598566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:41:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-89a884af-bf0f-4734-823a-cc29ed138cdd req-6c6fcc17-7b1d-42bb-8d0d-bba8a611239d tempest-TestShelveInstance-147598566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:41:41 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-89a884af-bf0f-4734-823a-cc29ed138cdd req-6c6fcc17-7b1d-42bb-8d0d-bba8a611239d tempest-TestShelveInstance-147598566 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e', 'name': 'volume-b1e78ceb-2416-42d0-bca1-69593c9c9218', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '539b2eff-ae61-4d92-b3d3-505152bda8d2', 'enforce_multipath': True} {{(pid=86854) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 14:41:41 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-89a884af-bf0f-4734-823a-cc29ed138cdd req-6c6fcc17-7b1d-42bb-8d0d-bba8a611239d tempest-TestShelveInstance-147598566 None] attachment_update completed successfully. Nov 06 14:41:51 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:UPDATE=13,cinder:SELECT=23,cinder:DELETE=2,cinder:INSERT=2 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:41:51 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=21,cinder:UPDATE=15,cinder:INSERT=3 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:42:12 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-c297e64a-fe13-4099-b5c7-e6ed001f7530 req-c8ba1c36-ddf9-43ae-b27f-b3eaf2a70e6a tempest-TestShelveInstance-147598566 None] Terminate volume connection completed successfully. Nov 06 14:42:12 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-c297e64a-fe13-4099-b5c7-e6ed001f7530 req-c8ba1c36-ddf9-43ae-b27f-b3eaf2a70e6a tempest-TestShelveInstance-147598566 None] Deleting attachment 539b2eff-ae61-4d92-b3d3-505152bda8d2. {{(pid=86854) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 14:42:12 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-c297e64a-fe13-4099-b5c7-e6ed001f7530 req-ddcecf9e-16dc-4fa1-8b8e-1b06fee77673 tempest-TestShelveInstance-147598566 None] Acquiring lock "cinder-b1e78ceb-2416-42d0-bca1-69593c9c9218-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:42:12 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-c297e64a-fe13-4099-b5c7-e6ed001f7530 req-ddcecf9e-16dc-4fa1-8b8e-1b06fee77673 tempest-TestShelveInstance-147598566 None] Lock "cinder-b1e78ceb-2416-42d0-bca1-69593c9c9218-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:42:12 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-c297e64a-fe13-4099-b5c7-e6ed001f7530 req-ddcecf9e-16dc-4fa1-8b8e-1b06fee77673 tempest-TestShelveInstance-147598566 None] Acquiring lock "cinder-quobyte-b1e78ceb-2416-42d0-bca1-69593c9c9218" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:42:12 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-c297e64a-fe13-4099-b5c7-e6ed001f7530 req-ddcecf9e-16dc-4fa1-8b8e-1b06fee77673 tempest-TestShelveInstance-147598566 None] Lock "cinder-quobyte-b1e78ceb-2416-42d0-bca1-69593c9c9218" acquired by "delete_volume" :: waited 0.022s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:42:12 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b029249-3fa9-4dcf-8e2b-03a4fb9f5c31]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:42:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-c297e64a-fe13-4099-b5c7-e6ed001f7530 req-ddcecf9e-16dc-4fa1-8b8e-1b06fee77673 tempest-TestShelveInstance-147598566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b1e78ceb-2416-42d0-bca1-69593c9c9218 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:42:12 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b1e78ceb-2416-42d0-bca1-69593c9c9218 Nov 06 14:42:12 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:42:12 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Nov 06 14:42:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-c297e64a-fe13-4099-b5c7-e6ed001f7530 req-ddcecf9e-16dc-4fa1-8b8e-1b06fee77673 tempest-TestShelveInstance-147598566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b1e78ceb-2416-42d0-bca1-69593c9c9218" returned: 0 in 0.436s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:42:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-c297e64a-fe13-4099-b5c7-e6ed001f7530 req-ddcecf9e-16dc-4fa1-8b8e-1b06fee77673 tempest-TestShelveInstance-147598566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b1e78ceb-2416-42d0-bca1-69593c9c9218 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:42:12 devstack sudo[102957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b1e78ceb-2416-42d0-bca1-69593c9c9218 Nov 06 14:42:12 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:42:13 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-c297e64a-fe13-4099-b5c7-e6ed001f7530 req-ddcecf9e-16dc-4fa1-8b8e-1b06fee77673 tempest-TestShelveInstance-147598566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b1e78ceb-2416-42d0-bca1-69593c9c9218" returned: 0 in 0.252s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-c297e64a-fe13-4099-b5c7-e6ed001f7530 req-ddcecf9e-16dc-4fa1-8b8e-1b06fee77673 tempest-TestShelveInstance-147598566 None] Lock "cinder-quobyte-b1e78ceb-2416-42d0-bca1-69593c9c9218" released by "delete_volume" :: held 0.766s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG cinder.quota [req-c297e64a-fe13-4099-b5c7-e6ed001f7530 req-ddcecf9e-16dc-4fa1-8b8e-1b06fee77673 tempest-TestShelveInstance-147598566 None] Created reservations ['0138c718-bd39-4914-b66d-ba4b60ed2b43', '7b6b6050-ca42-41f8-89a0-6165c87f7806', '36dc87e2-637d-4758-add3-b7e563c339cc', '0edcc5a4-a382-43aa-87c5-2715abec3369'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-c297e64a-fe13-4099-b5c7-e6ed001f7530 req-ddcecf9e-16dc-4fa1-8b8e-1b06fee77673 tempest-TestShelveInstance-147598566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-c297e64a-fe13-4099-b5c7-e6ed001f7530 req-ddcecf9e-16dc-4fa1-8b8e-1b06fee77673 tempest-TestShelveInstance-147598566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [req-c297e64a-fe13-4099-b5c7-e6ed001f7530 req-ddcecf9e-16dc-4fa1-8b8e-1b06fee77673 tempest-TestShelveInstance-147598566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [req-c297e64a-fe13-4099-b5c7-e6ed001f7530 req-ddcecf9e-16dc-4fa1-8b8e-1b06fee77673 tempest-TestShelveInstance-147598566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-c297e64a-fe13-4099-b5c7-e6ed001f7530 req-ddcecf9e-16dc-4fa1-8b8e-1b06fee77673 tempest-TestShelveInstance-147598566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-c297e64a-fe13-4099-b5c7-e6ed001f7530 req-ddcecf9e-16dc-4fa1-8b8e-1b06fee77673 tempest-TestShelveInstance-147598566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:42:13 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:42:13 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Flow 'volume_create_manager' (6f684a6b-0ed3-4736-8d80-60bfd91375fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a75f458d-939e-41e0-b97b-f34f16f53eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a75f458d-939e-41e0-b97b-f34f16f53eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1242040336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d754c5c-8bab-41ff-ba8d-df3d99b83a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a33a656e525460cb3da568562011f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:42:13Z,use_quota=True,user_id='bbaa94eb1ca341aeb2fb4afc6b9c83d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49aa51bc-4359-4ae4-ba66-132fd90f8ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49aa51bc-4359-4ae4-ba66-132fd90f8ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8beb91ed-7f88-436f-a63d-4f24c4554713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8beb91ed-7f88-436f-a63d-4f24c4554713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d754c5c-8bab-41ff-ba8d-df3d99b83a20', 'volume_name': 'volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9fe63f2-2227-4d1c-b62e-9e12b6fb1796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9fe63f2-2227-4d1c-b62e-9e12b6fb1796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4008efa-f67c-49a9-a229-f801d5bab9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:42:13 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Volume 2d754c5c-8bab-41ff-ba8d-df3d99b83a20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20', 'volume_size': 1} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1242040336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d754c5c-8bab-41ff-ba8d-df3d99b83a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a33a656e525460cb3da568562011f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:42:13Z,use_quota=True,user_id='bbaa94eb1ca341aeb2fb4afc6b9c83d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Creating volume 2d754c5c-8bab-41ff-ba8d-df3d99b83a20 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:42:13 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:42:13 devstack sudo[102962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20 1073741824 Nov 06 14:42:13 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:42:13 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [req-c297e64a-fe13-4099-b5c7-e6ed001f7530 req-ddcecf9e-16dc-4fa1-8b8e-1b06fee77673 tempest-TestShelveInstance-147598566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.292s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG cinder.manager [req-c297e64a-fe13-4099-b5c7-e6ed001f7530 req-ddcecf9e-16dc-4fa1-8b8e-1b06fee77673 tempest-TestShelveInstance-147598566 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:42:13 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-c297e64a-fe13-4099-b5c7-e6ed001f7530 req-ddcecf9e-16dc-4fa1-8b8e-1b06fee77673 tempest-TestShelveInstance-147598566 None] Deleted volume successfully. Nov 06 14:42:13 devstack cinder-volume[86854]: DEBUG cinder.coordination [req-c297e64a-fe13-4099-b5c7-e6ed001f7530 req-ddcecf9e-16dc-4fa1-8b8e-1b06fee77673 tempest-TestShelveInstance-147598566 None] Lock "cinder-b1e78ceb-2416-42d0-bca1-69593c9c9218-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:42:14 devstack sudo[102962]: pam_unix(sudo:session): session closed for user root Nov 06 14:42:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20 1073741824" returned: 0 in 0.493s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:42:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:42:14 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20 Nov 06 14:42:14 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:42:14 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Nov 06 14:42:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20" returned: 0 in 0.257s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:42:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:42:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:42:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4008efa-f67c-49a9-a229-f801d5bab9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:42:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (928383c1-dce1-4d9d-8980-c5ee6c144108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:42:14 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Volume volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20 (2d754c5c-8bab-41ff-ba8d-df3d99b83a20): created successfully Nov 06 14:42:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (928383c1-dce1-4d9d-8980-c5ee6c144108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:42:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Flow 'volume_create_manager' (6f684a6b-0ed3-4736-8d80-60bfd91375fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:42:14 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-86a73402-bb56-43ef-9f36-036930a0c93f tempest-TestImageHashVerification-1663505955 None] Created volume successfully. Nov 06 14:42:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7029a88f-38f6-4a9d-9e64-0af46435508e tempest-TestImageHashVerification-1663505955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:42:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7029a88f-38f6-4a9d-9e64-0af46435508e tempest-TestImageHashVerification-1663505955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:42:16 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccd0366-c3fc-42e2-9d8b-ab377b74a264]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:42:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7029a88f-38f6-4a9d-9e64-0af46435508e tempest-TestImageHashVerification-1663505955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:42:16 devstack sudo[102973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20 Nov 06 14:42:16 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:42:16 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root Nov 06 14:42:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7029a88f-38f6-4a9d-9e64-0af46435508e tempest-TestImageHashVerification-1663505955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20" returned: 0 in 0.369s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:42:16 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b8a142-ef8a-4a10-8c95-09edf605e116]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:42:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7029a88f-38f6-4a9d-9e64-0af46435508e tempest-TestImageHashVerification-1663505955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:42:16 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20 Nov 06 14:42:16 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:42:17 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Nov 06 14:42:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7029a88f-38f6-4a9d-9e64-0af46435508e tempest-TestImageHashVerification-1663505955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20" returned: 0 in 0.383s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:42:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7029a88f-38f6-4a9d-9e64-0af46435508e tempest-TestImageHashVerification-1663505955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20 /opt/stack/data/cinder/conversion/2d754c5c-8bab-41ff-ba8d-df3d99b83a20.temp_image.fe0286f2-b273-4703-8a0f-91c7b3fb6ca5u3mn0ug6.img {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:42:17 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20 /opt/stack/data/cinder/conversion/2d754c5c-8bab-41ff-ba8d-df3d99b83a20.temp_image.fe0286f2-b273-4703-8a0f-91c7b3fb6ca5u3mn0ug6.img Nov 06 14:42:17 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:42:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:42:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:42:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:42:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:42:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:42:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:42:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:42:23 devstack sudo[103001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:42:23 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:42:23 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root Nov 06 14:42:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.476s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:42:23 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:42:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager._thread_info {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:42:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread count: 28 {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 14:42:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread info: [<_MainThread(MainThread, started 130306900594816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 14:42:24 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Nov 06 14:42:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7029a88f-38f6-4a9d-9e64-0af46435508e tempest-TestImageHashVerification-1663505955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20 /opt/stack/data/cinder/conversion/2d754c5c-8bab-41ff-ba8d-df3d99b83a20.temp_image.fe0286f2-b273-4703-8a0f-91c7b3fb6ca5u3mn0ug6.img" returned: 0 in 7.004s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:42:24 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[c916953a-8093-4642-9da1-c58743e9c3b5]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:42:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7029a88f-38f6-4a9d-9e64-0af46435508e tempest-TestImageHashVerification-1663505955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:42:24 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20 Nov 06 14:42:24 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:42:24 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:42:24 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Nov 06 14:42:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7029a88f-38f6-4a9d-9e64-0af46435508e tempest-TestImageHashVerification-1663505955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20" returned: 0 in 0.564s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:42:24 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-7029a88f-38f6-4a9d-9e64-0af46435508e tempest-TestImageHashVerification-1663505955 None] Image conversion details: src /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20, size 1024.00 MB, duration 7.01 sec, destination /opt/stack/data/cinder/conversion/2d754c5c-8bab-41ff-ba8d-df3d99b83a20.temp_image.fe0286f2-b273-4703-8a0f-91c7b3fb6ca5u3mn0ug6.img {{(pid=86854) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 14:42:24 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-7029a88f-38f6-4a9d-9e64-0af46435508e tempest-TestImageHashVerification-1663505955 None] Converted 1024.00 MB image at 146.18 MB/s Nov 06 14:42:24 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-7029a88f-38f6-4a9d-9e64-0af46435508e tempest-TestImageHashVerification-1663505955 None] fe0286f2-b273-4703-8a0f-91c7b3fb6ca5 was raw, no need to convert to raw {{(pid=86854) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 06 14:42:34 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=7,cinder:UPDATE=13,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:42:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7029a88f-38f6-4a9d-9e64-0af46435508e tempest-TestImageHashVerification-1663505955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.548s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:42:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7029a88f-38f6-4a9d-9e64-0af46435508e tempest-TestImageHashVerification-1663505955 None] Uploaded volume to glance image-id: fe0286f2-b273-4703-8a0f-91c7b3fb6ca5. {{(pid=86854) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 06 14:42:44 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-7029a88f-38f6-4a9d-9e64-0af46435508e tempest-TestImageHashVerification-1663505955 None] Copy volume to image completed successfully. Nov 06 14:42:46 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-25acf628-256b-4886-96d5-f43e16f5323c tempest-TestImageHashVerification-1663505955 None] Acquiring lock "cinder-2d754c5c-8bab-41ff-ba8d-df3d99b83a20-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:42:46 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-25acf628-256b-4886-96d5-f43e16f5323c tempest-TestImageHashVerification-1663505955 None] Lock "cinder-2d754c5c-8bab-41ff-ba8d-df3d99b83a20-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:42:46 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-25acf628-256b-4886-96d5-f43e16f5323c tempest-TestImageHashVerification-1663505955 None] Acquiring lock "cinder-quobyte-2d754c5c-8bab-41ff-ba8d-df3d99b83a20" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:42:46 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-25acf628-256b-4886-96d5-f43e16f5323c tempest-TestImageHashVerification-1663505955 None] Lock "cinder-quobyte-2d754c5c-8bab-41ff-ba8d-df3d99b83a20" acquired by "delete_volume" :: waited 0.016s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:42:46 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddef9f18-b1f3-41a0-ab1f-9d199a7afe74]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:42:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25acf628-256b-4886-96d5-f43e16f5323c tempest-TestImageHashVerification-1663505955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:42:46 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20 Nov 06 14:42:46 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:42:46 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Nov 06 14:42:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25acf628-256b-4886-96d5-f43e16f5323c tempest-TestImageHashVerification-1663505955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20" returned: 0 in 0.379s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:42:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25acf628-256b-4886-96d5-f43e16f5323c tempest-TestImageHashVerification-1663505955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:42:46 devstack sudo[103019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20 Nov 06 14:42:46 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:42:46 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root Nov 06 14:42:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25acf628-256b-4886-96d5-f43e16f5323c tempest-TestImageHashVerification-1663505955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-2d754c5c-8bab-41ff-ba8d-df3d99b83a20" returned: 0 in 0.254s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:42:46 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-25acf628-256b-4886-96d5-f43e16f5323c tempest-TestImageHashVerification-1663505955 None] Lock "cinder-quobyte-2d754c5c-8bab-41ff-ba8d-df3d99b83a20" released by "delete_volume" :: held 0.687s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:42:46 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-25acf628-256b-4886-96d5-f43e16f5323c tempest-TestImageHashVerification-1663505955 None] Created reservations ['c91aa2e1-13c1-47ed-b586-e673967b20ec', '05be8760-39d3-47bc-b5db-74f9b3ae7edb', '2506fa30-fb4b-4907-bd36-674a66f2fd12', '18ee4ed2-5510-4020-bf18-25480fbb2ea4'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:42:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-25acf628-256b-4886-96d5-f43e16f5323c tempest-TestImageHashVerification-1663505955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:42:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-25acf628-256b-4886-96d5-f43e16f5323c tempest-TestImageHashVerification-1663505955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:42:46 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-25acf628-256b-4886-96d5-f43e16f5323c tempest-TestImageHashVerification-1663505955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:42:46 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-25acf628-256b-4886-96d5-f43e16f5323c tempest-TestImageHashVerification-1663505955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:42:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-25acf628-256b-4886-96d5-f43e16f5323c tempest-TestImageHashVerification-1663505955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:42:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25acf628-256b-4886-96d5-f43e16f5323c tempest-TestImageHashVerification-1663505955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:42:47 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:42:47 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:42:47 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Nov 06 14:42:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-25acf628-256b-4886-96d5-f43e16f5323c tempest-TestImageHashVerification-1663505955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.257s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:42:47 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-25acf628-256b-4886-96d5-f43e16f5323c tempest-TestImageHashVerification-1663505955 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:42:47 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-25acf628-256b-4886-96d5-f43e16f5323c tempest-TestImageHashVerification-1663505955 None] Deleted volume successfully. Nov 06 14:42:47 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-25acf628-256b-4886-96d5-f43e16f5323c tempest-TestImageHashVerification-1663505955 None] Lock "cinder-2d754c5c-8bab-41ff-ba8d-df3d99b83a20-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:42:51 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:42:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Flow 'volume_create_manager' (5365cb14-71aa-4288-b027-80387daa65ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:42:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356311e9-9960-4558-a824-d015003da903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:42:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356311e9-9960-4558-a824-d015003da903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-912498287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9a19d1e-a571-427b-a7eb-437485b6be6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e626f23a9f33480c89f5618b1ba1c9aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:42:51Z,use_quota=True,user_id='0403fcca66bb42cc8829e4754c73ceae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:42:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a3bd5bf-542d-40ea-afaf-556d01e79598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:42:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a3bd5bf-542d-40ea-afaf-556d01e79598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:42:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99bd6da9-6621-4c71-aade-d172b8684a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:42:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99bd6da9-6621-4c71-aade-d172b8684a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9a19d1e-a571-427b-a7eb-437485b6be6a', 'volume_name': 'volume-d9a19d1e-a571-427b-a7eb-437485b6be6a', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:42:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa4bcc91-276a-4cba-88c2-cad9744d4bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:42:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa4bcc91-276a-4cba-88c2-cad9744d4bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:42:51 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8260e036-afd4-43ab-bc9b-4d6fdd297a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:42:51 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Volume d9a19d1e-a571-427b-a7eb-437485b6be6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9a19d1e-a571-427b-a7eb-437485b6be6a', 'volume_size': 1} Nov 06 14:42:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:42:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:42:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-912498287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9a19d1e-a571-427b-a7eb-437485b6be6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e626f23a9f33480c89f5618b1ba1c9aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:42:51Z,use_quota=True,user_id='0403fcca66bb42cc8829e4754c73ceae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:42:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Creating volume d9a19d1e-a571-427b-a7eb-437485b6be6a {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:42:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:42:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:42:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:42:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:42:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:42:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:42:51 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:42:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:42:51 devstack sudo[103028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a 1073741824 Nov 06 14:42:51 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:42:52 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root Nov 06 14:42:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a 1073741824" returned: 0 in 0.583s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:42:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:42:52 devstack sudo[103037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a Nov 06 14:42:52 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:42:52 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root Nov 06 14:42:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a" returned: 0 in 0.295s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:42:52 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:42:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:42:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8260e036-afd4-43ab-bc9b-4d6fdd297a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9a19d1e-a571-427b-a7eb-437485b6be6a', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:42:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61f8e284-2634-4aa2-9757-284be0d077ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:42:52 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Volume volume-d9a19d1e-a571-427b-a7eb-437485b6be6a (d9a19d1e-a571-427b-a7eb-437485b6be6a): created successfully Nov 06 14:42:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61f8e284-2634-4aa2-9757-284be0d077ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:42:52 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Flow 'volume_create_manager' (5365cb14-71aa-4288-b027-80387daa65ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:42:52 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-2dd775bc-06e8-4dbf-a927-86a3790cbb20 tempest-TestStampPattern-100495455 None] Created volume successfully. Nov 06 14:43:02 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=7,cinder:UPDATE=11,cinder:INSERT=3 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:43:02 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=8,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=2 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:43:04 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:43:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Flow 'volume_create_manager' (dee2785f-ddf3-440d-b596-ab7a4e1b4328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:43:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc6cf0e4-6be8-46ff-8e60-e16176911333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc6cf0e4-6be8-46ff-8e60-e16176911333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ac22c1-5182-413f-8350-2969050c736b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26a0e46539fe43cbba43fb1c1d7cfe8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:43:04Z,use_quota=True,user_id='a24a10379c814d86a775fb14dba055b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2380a9b6-79ef-4029-af71-4b134833501e),volume_type_id=2380a9b6-79ef-4029-af71-4b134833501e)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88da37c6-3197-444b-879a-080293c0dc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88da37c6-3197-444b-879a-080293c0dc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a30107-99ac-4cb6-9ce6-8bc55da3af22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:04 devstack cinder-volume[86854]: DEBUG cinder.image.glance [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Creating Keystone auth plugin from conf {{(pid=86854) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 14:43:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a30107-99ac-4cb6-9ce6-8bc55da3af22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e0ac22c1-5182-413f-8350-2969050c736b', 'volume_name': 'volume-e0ac22c1-5182-413f-8350-2969050c736b', 'volume_size': 1, 'image_id': 'd6dc7175-18a1-446a-bb05-d2a9ce21a879', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6dc7175-18a1-446a-bb05-d2a9ce21a879', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '607c61a342248432de17ec6da2ee4450', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '26a0e46539fe43cbba43fb1c1d7cfe8f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fa6e21e49fd4d96ac32467af7386b6e221370a63140225fad21a8e8b168e216563050bba12d13093b21e71eadcded364b2923016b8fdd0f0298d95cf2d77c8a3', 'id': 'd6dc7175-18a1-446a-bb05-d2a9ce21a879', 'created_at': datetime.datetime(2026, 11, 6, 13, 43, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 43, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6dc7175-18a1-446a-bb05-d2a9ce21a879/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb60930-d4a5-4ff4-b28b-7d89c6d773c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb60930-d4a5-4ff4-b28b-7d89c6d773c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d88a36-ee5c-4655-a82d-fa165c7d479b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:04 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Volume e0ac22c1-5182-413f-8350-2969050c736b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e0ac22c1-5182-413f-8350-2969050c736b', 'volume_size': 1, 'image_id': 'd6dc7175-18a1-446a-bb05-d2a9ce21a879', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6dc7175-18a1-446a-bb05-d2a9ce21a879', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '607c61a342248432de17ec6da2ee4450', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '26a0e46539fe43cbba43fb1c1d7cfe8f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fa6e21e49fd4d96ac32467af7386b6e221370a63140225fad21a8e8b168e216563050bba12d13093b21e71eadcded364b2923016b8fdd0f0298d95cf2d77c8a3', 'id': 'd6dc7175-18a1-446a-bb05-d2a9ce21a879', 'created_at': datetime.datetime(2026, 11, 6, 13, 43, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 43, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6dc7175-18a1-446a-bb05-d2a9ce21a879/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 06 14:43:04 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Trying to clone e0ac22c1-5182-413f-8350-2969050c736b from image d6dc7175-18a1-446a-bb05-d2a9ce21a879 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d6dc7175-18a1-446a-bb05-d2a9ce21a879', 'metadata': {}}]). {{(pid=86854) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 14:43:04 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d6dc7175-18a1-446a-bb05-d2a9ce21a879_qfa6rz2gdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 14:43:04 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Image download 0.00 MB at 0.00 MB/s Nov 06 14:43:04 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20535ba-9468-43e5-a99f-c2b15ce1ba67]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:43:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6dc7175-18a1-446a-bb05-d2a9ce21a879_qfa6rz2gdevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:04 devstack sudo[103133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6dc7175-18a1-446a-bb05-d2a9ce21a879_qfa6rz2gdevstack@QuobyteHD Nov 06 14:43:04 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:04 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6dc7175-18a1-446a-bb05-d2a9ce21a879_qfa6rz2gdevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6dc7175-18a1-446a-bb05-d2a9ce21a879_qfa6rz2gdevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:05 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6dc7175-18a1-446a-bb05-d2a9ce21a879_qfa6rz2gdevstack@QuobyteHD Nov 06 14:43:05 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:05 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6dc7175-18a1-446a-bb05-d2a9ce21a879_qfa6rz2gdevstack@QuobyteHD" returned: 1 in 0.332s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6dc7175-18a1-446a-bb05-d2a9ce21a879_qfa6rz2gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 14:43:05 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Temporary image d6dc7175-18a1-446a-bb05-d2a9ce21a879 is fetched for user a24a10379c814d86a775fb14dba055b9. {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 14:43:05 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08b818a-bac7-4d7c-bd0e-86e105cd8621]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:43:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6dc7175-18a1-446a-bb05-d2a9ce21a879_qfa6rz2gdevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:05 devstack sudo[103142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6dc7175-18a1-446a-bb05-d2a9ce21a879_qfa6rz2gdevstack@QuobyteHD Nov 06 14:43:05 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:05 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6dc7175-18a1-446a-bb05-d2a9ce21a879_qfa6rz2gdevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6dc7175-18a1-446a-bb05-d2a9ce21a879_qfa6rz2gdevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:05 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6dc7175-18a1-446a-bb05-d2a9ce21a879_qfa6rz2gdevstack@QuobyteHD Nov 06 14:43:05 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:06 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6dc7175-18a1-446a-bb05-d2a9ce21a879_qfa6rz2gdevstack@QuobyteHD" returned: 1 in 0.350s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6dc7175-18a1-446a-bb05-d2a9ce21a879_qfa6rz2gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 14:43:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ac22c1-5182-413f-8350-2969050c736b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26a0e46539fe43cbba43fb1c1d7cfe8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:43:04Z,use_quota=True,user_id='a24a10379c814d86a775fb14dba055b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2380a9b6-79ef-4029-af71-4b134833501e),volume_type_id=2380a9b6-79ef-4029-af71-4b134833501e)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:43:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Creating volume e0ac22c1-5182-413f-8350-2969050c736b {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:43:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:43:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:43:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:43:06 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:43:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ac22c1-5182-413f-8350-2969050c736b 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:06 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ac22c1-5182-413f-8350-2969050c736b 1073741824 Nov 06 14:43:06 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:06 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ac22c1-5182-413f-8350-2969050c736b 1073741824" returned: 0 in 0.425s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ac22c1-5182-413f-8350-2969050c736b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:06 devstack sudo[103156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ac22c1-5182-413f-8350-2969050c736b Nov 06 14:43:06 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:06 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ac22c1-5182-413f-8350-2969050c736b" returned: 0 in 0.246s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:43:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:06 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Attempting download of d6dc7175-18a1-446a-bb05-d2a9ce21a879 ((None, [{'url': 'file:///opt/stack/data/glance/images/d6dc7175-18a1-446a-bb05-d2a9ce21a879', 'metadata': {}}])) to volume e0ac22c1-5182-413f-8350-2969050c736b. {{(pid=86854) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 14:43:06 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[65586e35-0d7a-415e-9282-2f3da4c01e2e]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:43:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6dc7175-18a1-446a-bb05-d2a9ce21a879_xohel0bb {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:06 devstack sudo[103159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6dc7175-18a1-446a-bb05-d2a9ce21a879_xohel0bb Nov 06 14:43:06 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:07 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6dc7175-18a1-446a-bb05-d2a9ce21a879_xohel0bb" returned: 0 in 0.321s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6dc7175-18a1-446a-bb05-d2a9ce21a879_xohel0bb {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:07 devstack sudo[103163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6dc7175-18a1-446a-bb05-d2a9ce21a879_xohel0bb Nov 06 14:43:07 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:07 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6dc7175-18a1-446a-bb05-d2a9ce21a879_xohel0bb" returned: 1 in 0.335s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6dc7175-18a1-446a-bb05-d2a9ce21a879_xohel0bb' failed. Not Retrying. {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 14:43:07 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93c7a7f-3938-4ce2-9660-eba2fe404c1c]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:43:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6dc7175-18a1-446a-bb05-d2a9ce21a879_qfa6rz2gdevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:07 devstack sudo[103173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6dc7175-18a1-446a-bb05-d2a9ce21a879_qfa6rz2gdevstack@QuobyteHD Nov 06 14:43:07 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:07 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6dc7175-18a1-446a-bb05-d2a9ce21a879_qfa6rz2gdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6dc7175-18a1-446a-bb05-d2a9ce21a879_qfa6rz2gdevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:07 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6dc7175-18a1-446a-bb05-d2a9ce21a879_qfa6rz2gdevstack@QuobyteHD Nov 06 14:43:07 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:08 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6dc7175-18a1-446a-bb05-d2a9ce21a879_qfa6rz2gdevstack@QuobyteHD" returned: 1 in 0.329s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6dc7175-18a1-446a-bb05-d2a9ce21a879_qfa6rz2gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 14:43:08 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] d6dc7175-18a1-446a-bb05-d2a9ce21a879 was raw, converting to qcow2 {{(pid=86854) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 14:43:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d6dc7175-18a1-446a-bb05-d2a9ce21a879_qfa6rz2gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ac22c1-5182-413f-8350-2969050c736b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:08 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d6dc7175-18a1-446a-bb05-d2a9ce21a879_qfa6rz2gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ac22c1-5182-413f-8350-2969050c736b Nov 06 14:43:08 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:08 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d6dc7175-18a1-446a-bb05-d2a9ce21a879_qfa6rz2gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ac22c1-5182-413f-8350-2969050c736b" returned: 0 in 0.435s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:08 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d6dc7175-18a1-446a-bb05-d2a9ce21a879_qfa6rz2gdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ac22c1-5182-413f-8350-2969050c736b {{(pid=86854) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 14:43:08 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 14:43:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ac22c1-5182-413f-8350-2969050c736b 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:08 devstack sudo[103187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ac22c1-5182-413f-8350-2969050c736b 1G Nov 06 14:43:08 devstack sudo[103187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:08 devstack sudo[103187]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ac22c1-5182-413f-8350-2969050c736b 1G" returned: 0 in 0.316s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:08 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Downloaded image d6dc7175-18a1-446a-bb05-d2a9ce21a879 ((None, [{'url': 'file:///opt/stack/data/glance/images/d6dc7175-18a1-446a-bb05-d2a9ce21a879', 'metadata': {}}])) to volume e0ac22c1-5182-413f-8350-2969050c736b successfully. {{(pid=86854) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 14:43:08 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Temporary image d6dc7175-18a1-446a-bb05-d2a9ce21a879 for user a24a10379c814d86a775fb14dba055b9 is deleted. {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 14:43:08 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Marking volume e0ac22c1-5182-413f-8350-2969050c736b as bootable. {{(pid=86854) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 14:43:08 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Copying metadata from image d6dc7175-18a1-446a-bb05-d2a9ce21a879 to e0ac22c1-5182-413f-8350-2969050c736b. {{(pid=86854) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 14:43:08 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Creating volume glance metadata for volume e0ac22c1-5182-413f-8350-2969050c736b backed by image d6dc7175-18a1-446a-bb05-d2a9ce21a879 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd6dc7175-18a1-446a-bb05-d2a9ce21a879', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '607c61a342248432de17ec6da2ee4450', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86854) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 14:43:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d88a36-ee5c-4655-a82d-fa165c7d479b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0ac22c1-5182-413f-8350-2969050c736b', 'volume_size': 1, 'image_id': 'd6dc7175-18a1-446a-bb05-d2a9ce21a879', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6dc7175-18a1-446a-bb05-d2a9ce21a879', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '607c61a342248432de17ec6da2ee4450', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '26a0e46539fe43cbba43fb1c1d7cfe8f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fa6e21e49fd4d96ac32467af7386b6e221370a63140225fad21a8e8b168e216563050bba12d13093b21e71eadcded364b2923016b8fdd0f0298d95cf2d77c8a3', 'id': 'd6dc7175-18a1-446a-bb05-d2a9ce21a879', 'created_at': datetime.datetime(2026, 11, 6, 13, 43, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 43, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6dc7175-18a1-446a-bb05-d2a9ce21a879/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd556a28-e5e9-43c3-b9ce-0efdaf453bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:09 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Volume volume-e0ac22c1-5182-413f-8350-2969050c736b (e0ac22c1-5182-413f-8350-2969050c736b): created successfully Nov 06 14:43:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd556a28-e5e9-43c3-b9ce-0efdaf453bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:09 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Flow 'volume_create_manager' (dee2785f-ddf3-440d-b596-ab7a4e1b4328) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:43:09 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-fe6c761c-da53-4bf1-a862-25babe2a9d86 tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Created volume successfully. Nov 06 14:43:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-5c630ba1-8d66-47fa-9d77-902460e8f69e tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Acquiring lock "cinder-e0ac22c1-5182-413f-8350-2969050c736b-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:43:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-5c630ba1-8d66-47fa-9d77-902460e8f69e tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Lock "cinder-e0ac22c1-5182-413f-8350-2969050c736b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:43:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-5c630ba1-8d66-47fa-9d77-902460e8f69e tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Acquiring lock "cinder-quobyte-e0ac22c1-5182-413f-8350-2969050c736b" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:43:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-5c630ba1-8d66-47fa-9d77-902460e8f69e tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Lock "cinder-quobyte-e0ac22c1-5182-413f-8350-2969050c736b" acquired by "delete_volume" :: waited 0.014s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:43:09 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8fba57-6168-42de-9401-bf0a3e4fc8d5]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:43:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5c630ba1-8d66-47fa-9d77-902460e8f69e tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ac22c1-5182-413f-8350-2969050c736b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:09 devstack sudo[103192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ac22c1-5182-413f-8350-2969050c736b Nov 06 14:43:09 devstack sudo[103192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:09 devstack sudo[103192]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5c630ba1-8d66-47fa-9d77-902460e8f69e tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ac22c1-5182-413f-8350-2969050c736b" returned: 0 in 0.378s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5c630ba1-8d66-47fa-9d77-902460e8f69e tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ac22c1-5182-413f-8350-2969050c736b {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:09 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ac22c1-5182-413f-8350-2969050c736b Nov 06 14:43:09 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:10 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5c630ba1-8d66-47fa-9d77-902460e8f69e tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e0ac22c1-5182-413f-8350-2969050c736b" returned: 0 in 0.272s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:10 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-5c630ba1-8d66-47fa-9d77-902460e8f69e tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Lock "cinder-quobyte-e0ac22c1-5182-413f-8350-2969050c736b" released by "delete_volume" :: held 0.691s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:43:10 devstack cinder-volume[86854]: WARNING cinder.quota [None req-5c630ba1-8d66-47fa-9d77-902460e8f69e tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:43:10 devstack cinder-volume[86854]: WARNING cinder.quota [None req-5c630ba1-8d66-47fa-9d77-902460e8f69e tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 06 14:43:10 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-5c630ba1-8d66-47fa-9d77-902460e8f69e tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Created reservations ['f1e6f7de-37b6-459d-ad70-5c1c8bbc6c16', '22993baf-363d-4c7f-ae02-b7207c3eb541', 'aa90543d-497e-4e38-bb85-f88989c7858d', '14835b58-5b20-4bf0-a9f3-3be2a0a0ad78'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:43:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5c630ba1-8d66-47fa-9d77-902460e8f69e tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5c630ba1-8d66-47fa-9d77-902460e8f69e tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:10 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5c630ba1-8d66-47fa-9d77-902460e8f69e tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:43:10 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5c630ba1-8d66-47fa-9d77-902460e8f69e tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:43:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5c630ba1-8d66-47fa-9d77-902460e8f69e tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5c630ba1-8d66-47fa-9d77-902460e8f69e tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:10 devstack sudo[103216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:43:10 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:10 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5c630ba1-8d66-47fa-9d77-902460e8f69e tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.246s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:10 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-5c630ba1-8d66-47fa-9d77-902460e8f69e tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:43:10 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-5c630ba1-8d66-47fa-9d77-902460e8f69e tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Deleted volume successfully. Nov 06 14:43:10 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-5c630ba1-8d66-47fa-9d77-902460e8f69e tempest-VolumeAndVolumeTypeFromImageTest-1635649473 None] Lock "cinder-e0ac22c1-5182-413f-8350-2969050c736b-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:43:14 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:43:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Flow 'volume_create_manager' (a7eacb2e-92ac-4fb3-82b0-34a97706aa8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:43:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb540f1-fa4e-4e24-9c02-b7a4ee2f7907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb540f1-fa4e-4e24-9c02-b7a4ee2f7907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1565977623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dcfac8a-fd46-4400-92bf-66f83732f9d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0db8b0959b724fcd9b0c5abdc7dd4de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:43:15Z,use_quota=True,user_id='16b079527f894972b354f95202aae52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee0a687-dbbc-403a-be4c-ae41736e9009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee0a687-dbbc-403a-be4c-ae41736e9009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a78f08-5e88-4c19-ad33-e5c84f8a15ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a78f08-5e88-4c19-ad33-e5c84f8a15ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dcfac8a-fd46-4400-92bf-66f83732f9d4', 'volume_name': 'volume-6dcfac8a-fd46-4400-92bf-66f83732f9d4', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3648c99d-d2ff-4998-9617-3287a49750a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3648c99d-d2ff-4998-9617-3287a49750a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941de780-e6d3-4c3b-9729-13e330229237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:14 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Volume 6dcfac8a-fd46-4400-92bf-66f83732f9d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dcfac8a-fd46-4400-92bf-66f83732f9d4', 'volume_size': 1} Nov 06 14:43:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1565977623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dcfac8a-fd46-4400-92bf-66f83732f9d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0db8b0959b724fcd9b0c5abdc7dd4de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:43:15Z,use_quota=True,user_id='16b079527f894972b354f95202aae52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:43:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Creating volume 6dcfac8a-fd46-4400-92bf-66f83732f9d4 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:43:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:43:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:43:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:43:14 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:43:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6dcfac8a-fd46-4400-92bf-66f83732f9d4 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:14 devstack sudo[103255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6dcfac8a-fd46-4400-92bf-66f83732f9d4 1073741824 Nov 06 14:43:14 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:14 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:43:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Flow 'volume_create_manager' (5898af35-2a67-4d31-acdf-7e00926ed003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:43:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2627106-d19f-4535-aedb-ad01413bdbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2627106-d19f-4535-aedb-ad01413bdbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1898837620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8043332a-a19d-4c48-8046-d3cc528d673d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0db8b0959b724fcd9b0c5abdc7dd4de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:43:15Z,use_quota=True,user_id='16b079527f894972b354f95202aae52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32fe9469-099d-45d2-bcd3-07bd988ac688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32fe9469-099d-45d2-bcd3-07bd988ac688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6736d15e-13eb-4aaa-b10e-f2d11274ee0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6736d15e-13eb-4aaa-b10e-f2d11274ee0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8043332a-a19d-4c48-8046-d3cc528d673d', 'volume_name': 'volume-8043332a-a19d-4c48-8046-d3cc528d673d', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35faa84-4f30-45ed-aa5a-09bac29961b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35faa84-4f30-45ed-aa5a-09bac29961b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24d0185-c7e2-43d4-b75d-762920bad97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:15 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Volume 8043332a-a19d-4c48-8046-d3cc528d673d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8043332a-a19d-4c48-8046-d3cc528d673d', 'volume_size': 1} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:15 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6dcfac8a-fd46-4400-92bf-66f83732f9d4 1073741824" returned: 0 in 0.495s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6dcfac8a-fd46-4400-92bf-66f83732f9d4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:15 devstack sudo[103261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6dcfac8a-fd46-4400-92bf-66f83732f9d4 Nov 06 14:43:15 devstack sudo[103261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Flow 'volume_create_manager' (5313a9e5-4dba-4d46-954f-be54a5e30bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e64faeac-1229-46f6-a418-65961f386d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e64faeac-1229-46f6-a418-65961f386d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1666583705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59261c4e-d149-451d-bcb0-46e64ee74c61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0db8b0959b724fcd9b0c5abdc7dd4de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:43:15Z,use_quota=True,user_id='16b079527f894972b354f95202aae52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b8ed27f-474b-47fc-9d21-a8cfd334e33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b8ed27f-474b-47fc-9d21-a8cfd334e33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f479e6a-4b53-4268-aba9-1881461ee52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f479e6a-4b53-4268-aba9-1881461ee52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59261c4e-d149-451d-bcb0-46e64ee74c61', 'volume_name': 'volume-59261c4e-d149-451d-bcb0-46e64ee74c61', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ff465e-92a8-4e6f-bc0c-21d548f11c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ff465e-92a8-4e6f-bc0c-21d548f11c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f33a07-72b7-43e7-b432-302339dd0c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:15 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Volume 59261c4e-d149-451d-bcb0-46e64ee74c61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59261c4e-d149-451d-bcb0-46e64ee74c61', 'volume_size': 1} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:15 devstack sudo[103261]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6dcfac8a-fd46-4400-92bf-66f83732f9d4" returned: 0 in 0.285s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.467s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1898837620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8043332a-a19d-4c48-8046-d3cc528d673d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0db8b0959b724fcd9b0c5abdc7dd4de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:43:15Z,use_quota=True,user_id='16b079527f894972b354f95202aae52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Creating volume 8043332a-a19d-4c48-8046-d3cc528d673d {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:43:15 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8043332a-a19d-4c48-8046-d3cc528d673d 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941de780-e6d3-4c3b-9729-13e330229237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dcfac8a-fd46-4400-92bf-66f83732f9d4', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:15 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8043332a-a19d-4c48-8046-d3cc528d673d 1073741824 Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc99ce45-363f-4a92-858e-f0be7f328717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:15 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:15 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Volume volume-6dcfac8a-fd46-4400-92bf-66f83732f9d4 (6dcfac8a-fd46-4400-92bf-66f83732f9d4): created successfully Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc99ce45-363f-4a92-858e-f0be7f328717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Flow 'volume_create_manager' (a7eacb2e-92ac-4fb3-82b0-34a97706aa8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:43:15 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-6cc70d22-5f81-454b-b8b8-55a8f310a558 tempest-CreateVolumesFromImageTest-1209959566 None] Created volume successfully. Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Flow 'volume_create_manager' (1e13610e-053d-428e-bef3-e666dd6fd14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c90261e-2252-497a-8569-ad9ba9c75cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c90261e-2252-497a-8569-ad9ba9c75cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-63884853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c9b1555-8dff-44fb-b67c-2dccb66f4986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0db8b0959b724fcd9b0c5abdc7dd4de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:43:16Z,use_quota=True,user_id='16b079527f894972b354f95202aae52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b34a8972-b2fd-41aa-a335-2b5081eba643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b34a8972-b2fd-41aa-a335-2b5081eba643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0041013-3219-44c3-912a-8a6c31b0094e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0041013-3219-44c3-912a-8a6c31b0094e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c9b1555-8dff-44fb-b67c-2dccb66f4986', 'volume_name': 'volume-0c9b1555-8dff-44fb-b67c-2dccb66f4986', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c93bc47-a62f-4589-bfac-df77bc36fcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c93bc47-a62f-4589-bfac-df77bc36fcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd49fe63-a137-431b-a9da-c04deacea372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:15 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Volume 0c9b1555-8dff-44fb-b67c-2dccb66f4986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c9b1555-8dff-44fb-b67c-2dccb66f4986', 'volume_size': 1} Nov 06 14:43:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:43:16 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Flow 'volume_create_manager' (5e0b94fc-5d59-45aa-a930-39dda212dcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31944357-4904-4a6f-ad5a-55e0836577ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8043332a-a19d-4c48-8046-d3cc528d673d 1073741824" returned: 0 in 0.533s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31944357-4904-4a6f-ad5a-55e0836577ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1571314696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22c7b64c-fbd4-4b1e-b408-fd46620e80ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0db8b0959b724fcd9b0c5abdc7dd4de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:43:16Z,use_quota=True,user_id='16b079527f894972b354f95202aae52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d46e5972-b836-482b-b71c-a5ddc32e1617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d46e5972-b836-482b-b71c-a5ddc32e1617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8154289c-de5b-4f91-ab43-63a7e66482bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8154289c-de5b-4f91-ab43-63a7e66482bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22c7b64c-fbd4-4b1e-b408-fd46620e80ac', 'volume_name': 'volume-22c7b64c-fbd4-4b1e-b408-fd46620e80ac', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b24758-b2de-4157-8d0b-fb1c7538a645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b24758-b2de-4157-8d0b-fb1c7538a645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063e64e1-f9e1-4eca-96af-a61d0dbb1e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:16 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Volume 22c7b64c-fbd4-4b1e-b408-fd46620e80ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22c7b64c-fbd4-4b1e-b408-fd46620e80ac', 'volume_size': 1} Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8043332a-a19d-4c48-8046-d3cc528d673d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:16 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8043332a-a19d-4c48-8046-d3cc528d673d Nov 06 14:43:16 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:16 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8043332a-a19d-4c48-8046-d3cc528d673d" returned: 0 in 0.246s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.982s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1666583705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59261c4e-d149-451d-bcb0-46e64ee74c61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0db8b0959b724fcd9b0c5abdc7dd4de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:43:15Z,use_quota=True,user_id='16b079527f894972b354f95202aae52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Creating volume 59261c4e-d149-451d-bcb0-46e64ee74c61 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:43:16 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-59261c4e-d149-451d-bcb0-46e64ee74c61 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24d0185-c7e2-43d4-b75d-762920bad97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8043332a-a19d-4c48-8046-d3cc528d673d', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:16 devstack sudo[103273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-59261c4e-d149-451d-bcb0-46e64ee74c61 1073741824 Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04cc8384-6947-43bf-9dc4-828d19836022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:16 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:16 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Volume volume-8043332a-a19d-4c48-8046-d3cc528d673d (8043332a-a19d-4c48-8046-d3cc528d673d): created successfully Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04cc8384-6947-43bf-9dc4-828d19836022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Flow 'volume_create_manager' (5898af35-2a67-4d31-acdf-7e00926ed003) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:43:16 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-b08d744c-30be-444b-b9b6-eef1e2ca27b2 tempest-CreateVolumesFromImageTest-1209959566 None] Created volume successfully. Nov 06 14:43:16 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-59261c4e-d149-451d-bcb0-46e64ee74c61 1073741824" returned: 0 in 0.452s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-59261c4e-d149-451d-bcb0-46e64ee74c61 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:16 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-59261c4e-d149-451d-bcb0-46e64ee74c61 Nov 06 14:43:16 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:17 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-59261c4e-d149-451d-bcb0-46e64ee74c61" returned: 0 in 0.271s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.376s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-63884853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c9b1555-8dff-44fb-b67c-2dccb66f4986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0db8b0959b724fcd9b0c5abdc7dd4de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:43:16Z,use_quota=True,user_id='16b079527f894972b354f95202aae52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Creating volume 0c9b1555-8dff-44fb-b67c-2dccb66f4986 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:43:17 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0c9b1555-8dff-44fb-b67c-2dccb66f4986 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f33a07-72b7-43e7-b432-302339dd0c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59261c4e-d149-451d-bcb0-46e64ee74c61', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:17 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0c9b1555-8dff-44fb-b67c-2dccb66f4986 1073741824 Nov 06 14:43:17 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f573d2-178b-445d-a455-2c7b958e6897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:17 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Volume volume-59261c4e-d149-451d-bcb0-46e64ee74c61 (59261c4e-d149-451d-bcb0-46e64ee74c61): created successfully Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f573d2-178b-445d-a455-2c7b958e6897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Flow 'volume_create_manager' (5313a9e5-4dba-4d46-954f-be54a5e30bf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:43:17 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-8a5454d5-666d-4988-83e4-c6b20eeb5b02 tempest-CreateVolumesFromImageTest-1209959566 None] Created volume successfully. Nov 06 14:43:17 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0c9b1555-8dff-44fb-b67c-2dccb66f4986 1073741824" returned: 0 in 0.418s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0c9b1555-8dff-44fb-b67c-2dccb66f4986 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:17 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0c9b1555-8dff-44fb-b67c-2dccb66f4986 Nov 06 14:43:17 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:17 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0c9b1555-8dff-44fb-b67c-2dccb66f4986" returned: 0 in 0.254s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.775s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1571314696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22c7b64c-fbd4-4b1e-b408-fd46620e80ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0db8b0959b724fcd9b0c5abdc7dd4de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:43:16Z,use_quota=True,user_id='16b079527f894972b354f95202aae52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Creating volume 22c7b64c-fbd4-4b1e-b408-fd46620e80ac {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:43:17 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-22c7b64c-fbd4-4b1e-b408-fd46620e80ac 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd49fe63-a137-431b-a9da-c04deacea372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c9b1555-8dff-44fb-b67c-2dccb66f4986', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d42a47-7ecb-4fa0-805f-be7ad7529b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:17 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-22c7b64c-fbd4-4b1e-b408-fd46620e80ac 1073741824 Nov 06 14:43:17 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:17 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Volume volume-0c9b1555-8dff-44fb-b67c-2dccb66f4986 (0c9b1555-8dff-44fb-b67c-2dccb66f4986): created successfully Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d42a47-7ecb-4fa0-805f-be7ad7529b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Flow 'volume_create_manager' (1e13610e-053d-428e-bef3-e666dd6fd14a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:43:17 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-fbc302fc-adc2-42f1-b1cd-c7b88e495709 tempest-CreateVolumesFromImageTest-1209959566 None] Created volume successfully. Nov 06 14:43:18 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-22c7b64c-fbd4-4b1e-b408-fd46620e80ac 1073741824" returned: 0 in 0.481s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-22c7b64c-fbd4-4b1e-b408-fd46620e80ac {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:18 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-22c7b64c-fbd4-4b1e-b408-fd46620e80ac Nov 06 14:43:18 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:18 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-22c7b64c-fbd4-4b1e-b408-fd46620e80ac" returned: 0 in 0.243s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:18 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:43:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:18 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063e64e1-f9e1-4eca-96af-a61d0dbb1e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22c7b64c-fbd4-4b1e-b408-fd46620e80ac', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:18 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd603f9-bbed-4819-b67c-a9f1ab4becdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:18 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Volume volume-22c7b64c-fbd4-4b1e-b408-fd46620e80ac (22c7b64c-fbd4-4b1e-b408-fd46620e80ac): created successfully Nov 06 14:43:18 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd603f9-bbed-4819-b67c-a9f1ab4becdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:18 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Flow 'volume_create_manager' (5e0b94fc-5d59-45aa-a930-39dda212dcef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:43:18 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-bbb174b0-029b-4b78-8154-c34ad232826f tempest-CreateVolumesFromImageTest-1209959566 None] Created volume successfully. Nov 06 14:43:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7676f65f-52b4-43f4-ae96-453e8ae2163f tempest-CreateVolumesFromImageTest-1209959566 None] Acquiring lock "cinder-22c7b64c-fbd4-4b1e-b408-fd46620e80ac-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:43:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7676f65f-52b4-43f4-ae96-453e8ae2163f tempest-CreateVolumesFromImageTest-1209959566 None] Lock "cinder-22c7b64c-fbd4-4b1e-b408-fd46620e80ac-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:43:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7676f65f-52b4-43f4-ae96-453e8ae2163f tempest-CreateVolumesFromImageTest-1209959566 None] Acquiring lock "cinder-quobyte-22c7b64c-fbd4-4b1e-b408-fd46620e80ac" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:43:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7676f65f-52b4-43f4-ae96-453e8ae2163f tempest-CreateVolumesFromImageTest-1209959566 None] Lock "cinder-quobyte-22c7b64c-fbd4-4b1e-b408-fd46620e80ac" acquired by "delete_volume" :: waited 0.014s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:43:19 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69430b6-e727-4bb6-9757-ea5ca3916dbb]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:43:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7676f65f-52b4-43f4-ae96-453e8ae2163f tempest-CreateVolumesFromImageTest-1209959566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-22c7b64c-fbd4-4b1e-b408-fd46620e80ac {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:19 devstack sudo[103299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-22c7b64c-fbd4-4b1e-b408-fd46620e80ac Nov 06 14:43:19 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:19 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7676f65f-52b4-43f4-ae96-453e8ae2163f tempest-CreateVolumesFromImageTest-1209959566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-22c7b64c-fbd4-4b1e-b408-fd46620e80ac" returned: 0 in 0.354s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7676f65f-52b4-43f4-ae96-453e8ae2163f tempest-CreateVolumesFromImageTest-1209959566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-22c7b64c-fbd4-4b1e-b408-fd46620e80ac {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:19 devstack sudo[103305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-22c7b64c-fbd4-4b1e-b408-fd46620e80ac Nov 06 14:43:19 devstack sudo[103305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:20 devstack sudo[103305]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7676f65f-52b4-43f4-ae96-453e8ae2163f tempest-CreateVolumesFromImageTest-1209959566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-22c7b64c-fbd4-4b1e-b408-fd46620e80ac" returned: 0 in 0.254s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7676f65f-52b4-43f4-ae96-453e8ae2163f tempest-CreateVolumesFromImageTest-1209959566 None] Lock "cinder-quobyte-22c7b64c-fbd4-4b1e-b408-fd46620e80ac" released by "delete_volume" :: held 0.652s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:43:20 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-7676f65f-52b4-43f4-ae96-453e8ae2163f tempest-CreateVolumesFromImageTest-1209959566 None] Created reservations ['7822ec5e-1025-43ba-8e0a-ccf94c900e36', '45e11ea4-f8d7-4efc-bf64-281682ee3f77', '794a8913-8f0a-4de6-8849-4fe9c0bc8d6a', '1aadecef-96ff-4622-8281-bd852b6dcce8'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:43:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7676f65f-52b4-43f4-ae96-453e8ae2163f tempest-CreateVolumesFromImageTest-1209959566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7676f65f-52b4-43f4-ae96-453e8ae2163f tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7676f65f-52b4-43f4-ae96-453e8ae2163f tempest-CreateVolumesFromImageTest-1209959566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:43:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7676f65f-52b4-43f4-ae96-453e8ae2163f tempest-CreateVolumesFromImageTest-1209959566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:43:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7676f65f-52b4-43f4-ae96-453e8ae2163f tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7676f65f-52b4-43f4-ae96-453e8ae2163f tempest-CreateVolumesFromImageTest-1209959566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:20 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:43:20 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:20 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7676f65f-52b4-43f4-ae96-453e8ae2163f tempest-CreateVolumesFromImageTest-1209959566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.256s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:20 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-7676f65f-52b4-43f4-ae96-453e8ae2163f tempest-CreateVolumesFromImageTest-1209959566 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:43:20 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-7676f65f-52b4-43f4-ae96-453e8ae2163f tempest-CreateVolumesFromImageTest-1209959566 None] Deleted volume successfully. Nov 06 14:43:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-7676f65f-52b4-43f4-ae96-453e8ae2163f tempest-CreateVolumesFromImageTest-1209959566 None] Lock "cinder-22c7b64c-fbd4-4b1e-b408-fd46620e80ac-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:43:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-181cdbf7-04bc-420d-9bb8-1d907b75daa9 tempest-CreateVolumesFromImageTest-1209959566 None] Acquiring lock "cinder-0c9b1555-8dff-44fb-b67c-2dccb66f4986-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:43:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-181cdbf7-04bc-420d-9bb8-1d907b75daa9 tempest-CreateVolumesFromImageTest-1209959566 None] Lock "cinder-0c9b1555-8dff-44fb-b67c-2dccb66f4986-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:43:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-181cdbf7-04bc-420d-9bb8-1d907b75daa9 tempest-CreateVolumesFromImageTest-1209959566 None] Acquiring lock "cinder-quobyte-0c9b1555-8dff-44fb-b67c-2dccb66f4986" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:43:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-181cdbf7-04bc-420d-9bb8-1d907b75daa9 tempest-CreateVolumesFromImageTest-1209959566 None] Lock "cinder-quobyte-0c9b1555-8dff-44fb-b67c-2dccb66f4986" acquired by "delete_volume" :: waited 0.018s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:43:20 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[7036bb58-9369-4e93-a893-92b9f66ab5b9]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:43:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-181cdbf7-04bc-420d-9bb8-1d907b75daa9 tempest-CreateVolumesFromImageTest-1209959566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0c9b1555-8dff-44fb-b67c-2dccb66f4986 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:20 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0c9b1555-8dff-44fb-b67c-2dccb66f4986 Nov 06 14:43:20 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:21 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-181cdbf7-04bc-420d-9bb8-1d907b75daa9 tempest-CreateVolumesFromImageTest-1209959566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0c9b1555-8dff-44fb-b67c-2dccb66f4986" returned: 0 in 0.369s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-181cdbf7-04bc-420d-9bb8-1d907b75daa9 tempest-CreateVolumesFromImageTest-1209959566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0c9b1555-8dff-44fb-b67c-2dccb66f4986 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:21 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0c9b1555-8dff-44fb-b67c-2dccb66f4986 Nov 06 14:43:21 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:21 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-181cdbf7-04bc-420d-9bb8-1d907b75daa9 tempest-CreateVolumesFromImageTest-1209959566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0c9b1555-8dff-44fb-b67c-2dccb66f4986" returned: 0 in 0.248s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-181cdbf7-04bc-420d-9bb8-1d907b75daa9 tempest-CreateVolumesFromImageTest-1209959566 None] Lock "cinder-quobyte-0c9b1555-8dff-44fb-b67c-2dccb66f4986" released by "delete_volume" :: held 0.659s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:43:21 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-181cdbf7-04bc-420d-9bb8-1d907b75daa9 tempest-CreateVolumesFromImageTest-1209959566 None] Created reservations ['cc917211-1fdb-41e0-948c-2f20b646f91d', 'c9e9f764-45ff-4330-998c-b5c5e5b4e928', '6d5aa2cc-a5e9-4196-9d9d-82189dc14b6d', '067a5782-41b4-4d1a-9a55-c07b00b8ac0c'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:43:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-181cdbf7-04bc-420d-9bb8-1d907b75daa9 tempest-CreateVolumesFromImageTest-1209959566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-181cdbf7-04bc-420d-9bb8-1d907b75daa9 tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-181cdbf7-04bc-420d-9bb8-1d907b75daa9 tempest-CreateVolumesFromImageTest-1209959566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:43:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-181cdbf7-04bc-420d-9bb8-1d907b75daa9 tempest-CreateVolumesFromImageTest-1209959566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:43:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-181cdbf7-04bc-420d-9bb8-1d907b75daa9 tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-181cdbf7-04bc-420d-9bb8-1d907b75daa9 tempest-CreateVolumesFromImageTest-1209959566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:21 devstack sudo[103327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:43:21 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:21 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-181cdbf7-04bc-420d-9bb8-1d907b75daa9 tempest-CreateVolumesFromImageTest-1209959566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.250s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:21 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-181cdbf7-04bc-420d-9bb8-1d907b75daa9 tempest-CreateVolumesFromImageTest-1209959566 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:43:21 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-181cdbf7-04bc-420d-9bb8-1d907b75daa9 tempest-CreateVolumesFromImageTest-1209959566 None] Deleted volume successfully. Nov 06 14:43:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-181cdbf7-04bc-420d-9bb8-1d907b75daa9 tempest-CreateVolumesFromImageTest-1209959566 None] Lock "cinder-0c9b1555-8dff-44fb-b67c-2dccb66f4986-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:43:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-84bb4f9c-0f74-497e-9402-0751efb2710a tempest-CreateVolumesFromImageTest-1209959566 None] Acquiring lock "cinder-59261c4e-d149-451d-bcb0-46e64ee74c61-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:43:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-84bb4f9c-0f74-497e-9402-0751efb2710a tempest-CreateVolumesFromImageTest-1209959566 None] Lock "cinder-59261c4e-d149-451d-bcb0-46e64ee74c61-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:43:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-84bb4f9c-0f74-497e-9402-0751efb2710a tempest-CreateVolumesFromImageTest-1209959566 None] Acquiring lock "cinder-quobyte-59261c4e-d149-451d-bcb0-46e64ee74c61" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:43:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-84bb4f9c-0f74-497e-9402-0751efb2710a tempest-CreateVolumesFromImageTest-1209959566 None] Lock "cinder-quobyte-59261c4e-d149-451d-bcb0-46e64ee74c61" acquired by "delete_volume" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:43:21 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[495d7f07-6bb3-4936-9e46-30ac504a8540]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:43:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-84bb4f9c-0f74-497e-9402-0751efb2710a tempest-CreateVolumesFromImageTest-1209959566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-59261c4e-d149-451d-bcb0-46e64ee74c61 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:22 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-59261c4e-d149-451d-bcb0-46e64ee74c61 Nov 06 14:43:22 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:22 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-84bb4f9c-0f74-497e-9402-0751efb2710a tempest-CreateVolumesFromImageTest-1209959566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-59261c4e-d149-451d-bcb0-46e64ee74c61" returned: 0 in 0.374s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-84bb4f9c-0f74-497e-9402-0751efb2710a tempest-CreateVolumesFromImageTest-1209959566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-59261c4e-d149-451d-bcb0-46e64ee74c61 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:22 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-59261c4e-d149-451d-bcb0-46e64ee74c61 Nov 06 14:43:22 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:22 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-84bb4f9c-0f74-497e-9402-0751efb2710a tempest-CreateVolumesFromImageTest-1209959566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-59261c4e-d149-451d-bcb0-46e64ee74c61" returned: 0 in 0.283s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-84bb4f9c-0f74-497e-9402-0751efb2710a tempest-CreateVolumesFromImageTest-1209959566 None] Lock "cinder-quobyte-59261c4e-d149-451d-bcb0-46e64ee74c61" released by "delete_volume" :: held 0.710s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:43:22 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-84bb4f9c-0f74-497e-9402-0751efb2710a tempest-CreateVolumesFromImageTest-1209959566 None] Created reservations ['ed959415-e657-4997-b9ef-dd57dd49c085', 'c63b20ac-9e85-4136-bb7c-047bbc8dcf4f', '08143312-b0cc-4118-bb81-122510028d0c', '5cec7fd4-775d-404f-9fab-5ab9c3669637'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:43:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-0dfffcd9-0801-4c15-b5c6-37602239af56 req-08933bf4-1a00-4f36-852b-80d8b31edaa0 tempest-TestStampPattern-100495455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-0dfffcd9-0801-4c15-b5c6-37602239af56 req-08933bf4-1a00-4f36-852b-80d8b31edaa0 tempest-TestStampPattern-100495455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-0dfffcd9-0801-4c15-b5c6-37602239af56 req-08933bf4-1a00-4f36-852b-80d8b31edaa0 tempest-TestStampPattern-100495455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:22 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-0dfffcd9-0801-4c15-b5c6-37602239af56 req-08933bf4-1a00-4f36-852b-80d8b31edaa0 tempest-TestStampPattern-100495455 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e', 'name': 'volume-d9a19d1e-a571-427b-a7eb-437485b6be6a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '21613989-d7bb-46c7-974d-982b11f4a40c', 'enforce_multipath': True} {{(pid=86854) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 14:43:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-84bb4f9c-0f74-497e-9402-0751efb2710a tempest-CreateVolumesFromImageTest-1209959566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-84bb4f9c-0f74-497e-9402-0751efb2710a tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:22 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-84bb4f9c-0f74-497e-9402-0751efb2710a tempest-CreateVolumesFromImageTest-1209959566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:43:22 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-84bb4f9c-0f74-497e-9402-0751efb2710a tempest-CreateVolumesFromImageTest-1209959566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:43:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-84bb4f9c-0f74-497e-9402-0751efb2710a tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-84bb4f9c-0f74-497e-9402-0751efb2710a tempest-CreateVolumesFromImageTest-1209959566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:22 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:43:22 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:22 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-0dfffcd9-0801-4c15-b5c6-37602239af56 req-08933bf4-1a00-4f36-852b-80d8b31edaa0 tempest-TestStampPattern-100495455 None] attachment_update completed successfully. Nov 06 14:43:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1c3252b5-40e7-4e6a-a6b0-eb32d6c855aa tempest-CreateVolumesFromImageTest-1209959566 None] Acquiring lock "cinder-8043332a-a19d-4c48-8046-d3cc528d673d-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:43:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1c3252b5-40e7-4e6a-a6b0-eb32d6c855aa tempest-CreateVolumesFromImageTest-1209959566 None] Lock "cinder-8043332a-a19d-4c48-8046-d3cc528d673d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:43:23 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-84bb4f9c-0f74-497e-9402-0751efb2710a tempest-CreateVolumesFromImageTest-1209959566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.315s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:23 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-84bb4f9c-0f74-497e-9402-0751efb2710a tempest-CreateVolumesFromImageTest-1209959566 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:43:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1c3252b5-40e7-4e6a-a6b0-eb32d6c855aa tempest-CreateVolumesFromImageTest-1209959566 None] Acquiring lock "cinder-quobyte-8043332a-a19d-4c48-8046-d3cc528d673d" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:43:23 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-84bb4f9c-0f74-497e-9402-0751efb2710a tempest-CreateVolumesFromImageTest-1209959566 None] Deleted volume successfully. Nov 06 14:43:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:43:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:43:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:43:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1c3252b5-40e7-4e6a-a6b0-eb32d6c855aa tempest-CreateVolumesFromImageTest-1209959566 None] Lock "cinder-quobyte-8043332a-a19d-4c48-8046-d3cc528d673d" acquired by "delete_volume" :: waited 0.055s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:43:23 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:43:23 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-84bb4f9c-0f74-497e-9402-0751efb2710a tempest-CreateVolumesFromImageTest-1209959566 None] Lock "cinder-59261c4e-d149-451d-bcb0-46e64ee74c61-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:43:23 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe448c58-3290-44ef-b796-475a1eca4713]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:43:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1c3252b5-40e7-4e6a-a6b0-eb32d6c855aa tempest-CreateVolumesFromImageTest-1209959566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8043332a-a19d-4c48-8046-d3cc528d673d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:23 devstack sudo[103460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8043332a-a19d-4c48-8046-d3cc528d673d Nov 06 14:43:23 devstack sudo[103460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:23 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.289s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:23 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:43:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager._thread_info {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:43:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread count: 28 {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 14:43:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread info: [<_MainThread(MainThread, started 130306900594816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 14:43:23 devstack sudo[103460]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1c3252b5-40e7-4e6a-a6b0-eb32d6c855aa tempest-CreateVolumesFromImageTest-1209959566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8043332a-a19d-4c48-8046-d3cc528d673d" returned: 0 in 0.446s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1c3252b5-40e7-4e6a-a6b0-eb32d6c855aa tempest-CreateVolumesFromImageTest-1209959566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8043332a-a19d-4c48-8046-d3cc528d673d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:23 devstack sudo[103779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8043332a-a19d-4c48-8046-d3cc528d673d Nov 06 14:43:23 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:23 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1c3252b5-40e7-4e6a-a6b0-eb32d6c855aa tempest-CreateVolumesFromImageTest-1209959566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8043332a-a19d-4c48-8046-d3cc528d673d" returned: 0 in 0.253s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1c3252b5-40e7-4e6a-a6b0-eb32d6c855aa tempest-CreateVolumesFromImageTest-1209959566 None] Lock "cinder-quobyte-8043332a-a19d-4c48-8046-d3cc528d673d" released by "delete_volume" :: held 0.758s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:43:23 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-1c3252b5-40e7-4e6a-a6b0-eb32d6c855aa tempest-CreateVolumesFromImageTest-1209959566 None] Created reservations ['b4c76ab5-9607-4704-a4a4-6c93bf0aef2c', '20737214-61e1-4784-9e49-daeb87205c49', '44069d76-9139-43bc-a4dd-1020174f28fa', 'f43121ec-f8f1-4542-aab8-d84a3f4f0e57'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:43:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1c3252b5-40e7-4e6a-a6b0-eb32d6c855aa tempest-CreateVolumesFromImageTest-1209959566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1c3252b5-40e7-4e6a-a6b0-eb32d6c855aa tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1c3252b5-40e7-4e6a-a6b0-eb32d6c855aa tempest-CreateVolumesFromImageTest-1209959566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:43:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1c3252b5-40e7-4e6a-a6b0-eb32d6c855aa tempest-CreateVolumesFromImageTest-1209959566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:43:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1c3252b5-40e7-4e6a-a6b0-eb32d6c855aa tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1c3252b5-40e7-4e6a-a6b0-eb32d6c855aa tempest-CreateVolumesFromImageTest-1209959566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:24 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:43:24 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:24 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-5ea8d222-c49b-4077-9495-1236820f8cc6 tempest-CreateVolumesFromImageTest-1209959566 None] Acquiring lock "cinder-6dcfac8a-fd46-4400-92bf-66f83732f9d4-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:43:24 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-5ea8d222-c49b-4077-9495-1236820f8cc6 tempest-CreateVolumesFromImageTest-1209959566 None] Lock "cinder-6dcfac8a-fd46-4400-92bf-66f83732f9d4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:43:24 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-5ea8d222-c49b-4077-9495-1236820f8cc6 tempest-CreateVolumesFromImageTest-1209959566 None] Acquiring lock "cinder-quobyte-6dcfac8a-fd46-4400-92bf-66f83732f9d4" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:43:24 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-5ea8d222-c49b-4077-9495-1236820f8cc6 tempest-CreateVolumesFromImageTest-1209959566 None] Lock "cinder-quobyte-6dcfac8a-fd46-4400-92bf-66f83732f9d4" acquired by "delete_volume" :: waited 0.022s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:43:24 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1c3252b5-40e7-4e6a-a6b0-eb32d6c855aa tempest-CreateVolumesFromImageTest-1209959566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.272s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:24 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-1c3252b5-40e7-4e6a-a6b0-eb32d6c855aa tempest-CreateVolumesFromImageTest-1209959566 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:43:24 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff12596-5a13-4a30-bb26-e320542e104e]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:43:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5ea8d222-c49b-4077-9495-1236820f8cc6 tempest-CreateVolumesFromImageTest-1209959566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6dcfac8a-fd46-4400-92bf-66f83732f9d4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:24 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-1c3252b5-40e7-4e6a-a6b0-eb32d6c855aa tempest-CreateVolumesFromImageTest-1209959566 None] Deleted volume successfully. Nov 06 14:43:24 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1c3252b5-40e7-4e6a-a6b0-eb32d6c855aa tempest-CreateVolumesFromImageTest-1209959566 None] Lock "cinder-8043332a-a19d-4c48-8046-d3cc528d673d-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:43:24 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6dcfac8a-fd46-4400-92bf-66f83732f9d4 Nov 06 14:43:24 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:24 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5ea8d222-c49b-4077-9495-1236820f8cc6 tempest-CreateVolumesFromImageTest-1209959566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6dcfac8a-fd46-4400-92bf-66f83732f9d4" returned: 0 in 0.374s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5ea8d222-c49b-4077-9495-1236820f8cc6 tempest-CreateVolumesFromImageTest-1209959566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6dcfac8a-fd46-4400-92bf-66f83732f9d4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:24 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6dcfac8a-fd46-4400-92bf-66f83732f9d4 Nov 06 14:43:24 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:24 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5ea8d222-c49b-4077-9495-1236820f8cc6 tempest-CreateVolumesFromImageTest-1209959566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6dcfac8a-fd46-4400-92bf-66f83732f9d4" returned: 0 in 0.258s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:24 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-5ea8d222-c49b-4077-9495-1236820f8cc6 tempest-CreateVolumesFromImageTest-1209959566 None] Lock "cinder-quobyte-6dcfac8a-fd46-4400-92bf-66f83732f9d4" released by "delete_volume" :: held 0.680s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:43:25 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-5ea8d222-c49b-4077-9495-1236820f8cc6 tempest-CreateVolumesFromImageTest-1209959566 None] Created reservations ['159e2d8a-2526-4f41-9d56-d41c6c68b07f', '403b0929-1ca1-4dfd-9614-c1acbccbe55e', '5c4e9a6d-fffb-4019-b51d-d4e7998dac57', '565e6b5a-83d8-4111-afb7-e8ee5a57a910'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:43:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5ea8d222-c49b-4077-9495-1236820f8cc6 tempest-CreateVolumesFromImageTest-1209959566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5ea8d222-c49b-4077-9495-1236820f8cc6 tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5ea8d222-c49b-4077-9495-1236820f8cc6 tempest-CreateVolumesFromImageTest-1209959566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:43:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5ea8d222-c49b-4077-9495-1236820f8cc6 tempest-CreateVolumesFromImageTest-1209959566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:43:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5ea8d222-c49b-4077-9495-1236820f8cc6 tempest-CreateVolumesFromImageTest-1209959566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5ea8d222-c49b-4077-9495-1236820f8cc6 tempest-CreateVolumesFromImageTest-1209959566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:25 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:43:25 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:25 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5ea8d222-c49b-4077-9495-1236820f8cc6 tempest-CreateVolumesFromImageTest-1209959566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.269s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:25 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-5ea8d222-c49b-4077-9495-1236820f8cc6 tempest-CreateVolumesFromImageTest-1209959566 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:43:25 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-5ea8d222-c49b-4077-9495-1236820f8cc6 tempest-CreateVolumesFromImageTest-1209959566 None] Deleted volume successfully. Nov 06 14:43:25 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-5ea8d222-c49b-4077-9495-1236820f8cc6 tempest-CreateVolumesFromImageTest-1209959566 None] Lock "cinder-6dcfac8a-fd46-4400-92bf-66f83732f9d4-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:43:28 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-e1304b7f-c2e3-48c6-b8a6-9931fcd02d7c req-91bd6ed3-3e7d-4307-b60b-f06b05584ac5 tempest-TestStampPattern-100495455 None] Terminate volume connection completed successfully. Nov 06 14:43:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-e1304b7f-c2e3-48c6-b8a6-9931fcd02d7c req-91bd6ed3-3e7d-4307-b60b-f06b05584ac5 tempest-TestStampPattern-100495455 None] Deleting attachment 21613989-d7bb-46c7-974d-982b11f4a40c. {{(pid=86854) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 14:43:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-cc7df7ab-aac2-4bb2-9ca0-0820ae5fd66f tempest-TestStampPattern-100495455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-cc7df7ab-aac2-4bb2-9ca0-0820ae5fd66f tempest-TestStampPattern-100495455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:29 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-cc7df7ab-aac2-4bb2-9ca0-0820ae5fd66f tempest-TestStampPattern-100495455 None] Creating offline snapshot 83d73b21-e30f-4f80-bf61-590d10df8243 of volume d9a19d1e-a571-427b-a7eb-437485b6be6a {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:43:29 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[185e8bcb-661c-45f5-80a5-da1fb6bb4068]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:43:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cc7df7ab-aac2-4bb2-9ca0-0820ae5fd66f tempest-TestStampPattern-100495455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:29 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a Nov 06 14:43:29 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:29 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cc7df7ab-aac2-4bb2-9ca0-0820ae5fd66f tempest-TestStampPattern-100495455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a" returned: 0 in 0.381s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cc7df7ab-aac2-4bb2-9ca0-0820ae5fd66f tempest-TestStampPattern-100495455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.83d73b21-e30f-4f80-bf61-590d10df8243 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:29 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.83d73b21-e30f-4f80-bf61-590d10df8243 1G Nov 06 14:43:29 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:30 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cc7df7ab-aac2-4bb2-9ca0-0820ae5fd66f tempest-TestStampPattern-100495455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.83d73b21-e30f-4f80-bf61-590d10df8243 1G" returned: 0 in 0.435s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cc7df7ab-aac2-4bb2-9ca0-0820ae5fd66f tempest-TestStampPattern-100495455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9a19d1e-a571-427b-a7eb-437485b6be6a -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.83d73b21-e30f-4f80-bf61-590d10df8243 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:30 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9a19d1e-a571-427b-a7eb-437485b6be6a -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.83d73b21-e30f-4f80-bf61-590d10df8243 Nov 06 14:43:30 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:30 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cc7df7ab-aac2-4bb2-9ca0-0820ae5fd66f tempest-TestStampPattern-100495455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9a19d1e-a571-427b-a7eb-437485b6be6a -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.83d73b21-e30f-4f80-bf61-590d10df8243" returned: 0 in 0.296s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:30 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-cc7df7ab-aac2-4bb2-9ca0-0820ae5fd66f tempest-TestStampPattern-100495455 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.83d73b21-e30f-4f80-bf61-590d10df8243 is being set with open permissions: ugo+rw Nov 06 14:43:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cc7df7ab-aac2-4bb2-9ca0-0820ae5fd66f tempest-TestStampPattern-100495455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.83d73b21-e30f-4f80-bf61-590d10df8243 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:30 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.83d73b21-e30f-4f80-bf61-590d10df8243 Nov 06 14:43:30 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:30 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cc7df7ab-aac2-4bb2-9ca0-0820ae5fd66f tempest-TestStampPattern-100495455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.83d73b21-e30f-4f80-bf61-590d10df8243" returned: 0 in 0.260s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cc7df7ab-aac2-4bb2-9ca0-0820ae5fd66f tempest-TestStampPattern-100495455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:30 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.info Nov 06 14:43:30 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:30 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cc7df7ab-aac2-4bb2-9ca0-0820ae5fd66f tempest-TestStampPattern-100495455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.info" returned: 0 in 0.273s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:30 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-cc7df7ab-aac2-4bb2-9ca0-0820ae5fd66f tempest-TestStampPattern-100495455 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.info is being set with open permissions: ugo+rw Nov 06 14:43:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cc7df7ab-aac2-4bb2-9ca0-0820ae5fd66f tempest-TestStampPattern-100495455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:31 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.info Nov 06 14:43:31 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:31 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cc7df7ab-aac2-4bb2-9ca0-0820ae5fd66f tempest-TestStampPattern-100495455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.info" returned: 0 in 0.253s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-cc7df7ab-aac2-4bb2-9ca0-0820ae5fd66f tempest-TestStampPattern-100495455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.003s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:31 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-cc7df7ab-aac2-4bb2-9ca0-0820ae5fd66f tempest-TestStampPattern-100495455 None] Create snapshot completed successfully Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Flow 'volume_create_manager' (f7d4b748-4b15-4ca9-9881-d210e0821022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79535cfb-7fdb-434e-8310-59c3caa10685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79535cfb-7fdb-434e-8310-59c3caa10685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1955803732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e07250ad-2b77-473a-ac32-24968dbe45f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e626f23a9f33480c89f5618b1ba1c9aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=83d73b21-e30f-4f80-bf61-590d10df8243,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:43:38Z,use_quota=True,user_id='0403fcca66bb42cc8829e4754c73ceae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35df5e2f-757a-4d37-85af-83d6f9bf8e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35df5e2f-757a-4d37-85af-83d6f9bf8e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2219f73b-89ad-4862-b1f7-54e62f327c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2219f73b-89ad-4862-b1f7-54e62f327c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e07250ad-2b77-473a-ac32-24968dbe45f7', 'volume_name': 'volume-e07250ad-2b77-473a-ac32-24968dbe45f7', 'volume_size': 1, 'snapshot_id': '83d73b21-e30f-4f80-bf61-590d10df8243'}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b3e5b0-6d28-4ee1-8a11-b141ab78aaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b3e5b0-6d28-4ee1-8a11-b141ab78aaba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340c1f42-e107-4a33-9e87-e08b0f7f266b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:38 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Volume e07250ad-2b77-473a-ac32-24968dbe45f7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e07250ad-2b77-473a-ac32-24968dbe45f7', 'volume_size': 1, 'snapshot_id': '83d73b21-e30f-4f80-bf61-590d10df8243'} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Acquiring lock "cinder-quobyte-83d73b21-e30f-4f80-bf61-590d10df8243-e07250ad-2b77-473a-ac32-24968dbe45f7" by "_create_volume_from_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Lock "cinder-quobyte-83d73b21-e30f-4f80-bf61-590d10df8243-e07250ad-2b77-473a-ac32-24968dbe45f7" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Creating volume e07250ad-2b77-473a-ac32-24968dbe45f7 from snapshot 83d73b21-e30f-4f80-bf61-590d10df8243 {{(pid=86854) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Acquiring lock "cinder-quobyte-e07250ad-2b77-473a-ac32-24968dbe45f7" by "_copy_volume_from_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Lock "cinder-quobyte-e07250ad-2b77-473a-ac32-24968dbe45f7" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] snapshot: 83d73b21-e30f-4f80-bf61-590d10df8243, volume: e07250ad-2b77-473a-ac32-24968dbe45f7, {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[419314bb-eb67-4fa2-9024-9ef26a528f36]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:43:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.83d73b21-e30f-4f80-bf61-590d10df8243 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:38 devstack sudo[103899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.83d73b21-e30f-4f80-bf61-590d10df8243 Nov 06 14:43:38 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:39 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.83d73b21-e30f-4f80-bf61-590d10df8243" returned: 0 in 0.407s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:39 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9a19d1e-a571-427b-a7eb-437485b6be6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:43:39 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[034a56b2-8392-4d71-8866-dbbb7fb14145]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:43:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:39 devstack sudo[103905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a Nov 06 14:43:39 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:39 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a" returned: 0 in 0.478s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:39 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 14:43:39 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Creating direct copy from snapshot {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 14:43:39 devstack cinder-volume[86854]: DEBUG cinder.utils [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Path /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e07250ad-2b77-473a-ac32-24968dbe45f7 not found in is_blk_device check {{(pid=86854) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 14:43:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e07250ad-2b77-473a-ac32-24968dbe45f7 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:39 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e07250ad-2b77-473a-ac32-24968dbe45f7 Nov 06 14:43:39 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:48 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:UPDATE=69,cinder:SELECT=63,cinder:INSERT=19,cinder:DELETE=6 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:43:48 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=60,cinder:UPDATE=74,cinder:INSERT=22,cinder:DELETE=7 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:43:49 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e07250ad-2b77-473a-ac32-24968dbe45f7" returned: 0 in 9.705s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:49 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Image conversion details: src /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a, size 1024.00 MB, duration 9.71 sec, destination /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e07250ad-2b77-473a-ac32-24968dbe45f7 {{(pid=86854) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 14:43:49 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Converted 1024.00 MB image at 105.50 MB/s Nov 06 14:43:49 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e07250ad-2b77-473a-ac32-24968dbe45f7 is being set with open permissions: ugo+rw Nov 06 14:43:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e07250ad-2b77-473a-ac32-24968dbe45f7 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:49 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e07250ad-2b77-473a-ac32-24968dbe45f7 Nov 06 14:43:49 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:49 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e07250ad-2b77-473a-ac32-24968dbe45f7" returned: 0 in 0.420s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:49 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Lock "cinder-quobyte-e07250ad-2b77-473a-ac32-24968dbe45f7" released by "_copy_volume_from_snapshot" :: held 11.149s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:43:49 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Lock "cinder-quobyte-83d73b21-e30f-4f80-bf61-590d10df8243-e07250ad-2b77-473a-ac32-24968dbe45f7" released by "_create_volume_from_snapshot" :: held 11.270s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:43:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.298s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340c1f42-e107-4a33-9e87-e08b0f7f266b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e07250ad-2b77-473a-ac32-24968dbe45f7', 'volume_size': 1, 'snapshot_id': '83d73b21-e30f-4f80-bf61-590d10df8243'}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b41aea9-f563-4c87-b66e-3c5d9d846f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:49 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Volume volume-e07250ad-2b77-473a-ac32-24968dbe45f7 (e07250ad-2b77-473a-ac32-24968dbe45f7): created successfully Nov 06 14:43:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b41aea9-f563-4c87-b66e-3c5d9d846f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:49 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Flow 'volume_create_manager' (f7d4b748-4b15-4ca9-9881-d210e0821022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:43:49 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-9c0cb06c-bb34-4de3-b839-4c6692c8c6f6 tempest-TestStampPattern-100495455 None] Created volume successfully. Nov 06 14:43:54 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:43:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Flow 'volume_create_manager' (0850055b-ca99-46e4-9054-ac837344de3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:43:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb6ba719-ccb5-4e51-bce1-1fd8008146da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb6ba719-ccb5-4e51-bce1-1fd8008146da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1014414644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7336d0e3-0a40-4530-b9f6-576af939c9a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10cb26eb50740bda5ddf0977b61be4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:43:55Z,use_quota=True,user_id='9025e87a3a3146a28642f6ea7ab99548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f3a9bc4-e111-42b6-89d8-5a691afd5a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f3a9bc4-e111-42b6-89d8-5a691afd5a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e61546b5-a6ae-4a38-89e4-d64721b52f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e61546b5-a6ae-4a38-89e4-d64721b52f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7336d0e3-0a40-4530-b9f6-576af939c9a9', 'volume_name': 'volume-7336d0e3-0a40-4530-b9f6-576af939c9a9', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9ff2d23-0b61-4a78-ab7a-d225b8c0e99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9ff2d23-0b61-4a78-ab7a-d225b8c0e99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7322c0-fba6-4b2d-b37f-22c9e3cfae12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:54 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Volume 7336d0e3-0a40-4530-b9f6-576af939c9a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7336d0e3-0a40-4530-b9f6-576af939c9a9', 'volume_size': 1} Nov 06 14:43:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1014414644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7336d0e3-0a40-4530-b9f6-576af939c9a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10cb26eb50740bda5ddf0977b61be4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:43:55Z,use_quota=True,user_id='9025e87a3a3146a28642f6ea7ab99548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:43:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Creating volume 7336d0e3-0a40-4530-b9f6-576af939c9a9 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:43:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:43:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:43:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:43:54 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:43:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:54 devstack sudo[104005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9 1073741824 Nov 06 14:43:54 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:55 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9 1073741824" returned: 0 in 0.407s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:55 devstack sudo[104011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9 Nov 06 14:43:55 devstack sudo[104011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:55 devstack sudo[104011]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9" returned: 0 in 0.244s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:43:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7322c0-fba6-4b2d-b37f-22c9e3cfae12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7336d0e3-0a40-4530-b9f6-576af939c9a9', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd5ed8d-e62c-4716-ba52-0071c4a9101e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:55 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Volume volume-7336d0e3-0a40-4530-b9f6-576af939c9a9 (7336d0e3-0a40-4530-b9f6-576af939c9a9): created successfully Nov 06 14:43:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd5ed8d-e62c-4716-ba52-0071c4a9101e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Flow 'volume_create_manager' (0850055b-ca99-46e4-9054-ac837344de3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:43:55 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-b57b32c4-2d88-4066-9d7b-0c1eb86d3010 tempest-SnapshotDependencyTests-262966802 None] Created volume successfully. Nov 06 14:43:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d9431486-b73c-400c-9701-1fddc8232bdd tempest-SnapshotDependencyTests-262966802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d9431486-b73c-400c-9701-1fddc8232bdd tempest-SnapshotDependencyTests-262966802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:56 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-d9431486-b73c-400c-9701-1fddc8232bdd tempest-SnapshotDependencyTests-262966802 None] Creating offline snapshot 10439a4a-8438-4992-ae4a-8fb07604843d of volume 7336d0e3-0a40-4530-b9f6-576af939c9a9 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:43:56 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0887e9-ef42-4a43-865e-261b0f341a1b]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:43:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d9431486-b73c-400c-9701-1fddc8232bdd tempest-SnapshotDependencyTests-262966802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:56 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9 Nov 06 14:43:56 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:56 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d9431486-b73c-400c-9701-1fddc8232bdd tempest-SnapshotDependencyTests-262966802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9" returned: 0 in 0.372s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d9431486-b73c-400c-9701-1fddc8232bdd tempest-SnapshotDependencyTests-262966802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.10439a4a-8438-4992-ae4a-8fb07604843d 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:56 devstack sudo[104019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.10439a4a-8438-4992-ae4a-8fb07604843d 1G Nov 06 14:43:56 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:56 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d9431486-b73c-400c-9701-1fddc8232bdd tempest-SnapshotDependencyTests-262966802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.10439a4a-8438-4992-ae4a-8fb07604843d 1G" returned: 0 in 0.402s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d9431486-b73c-400c-9701-1fddc8232bdd tempest-SnapshotDependencyTests-262966802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7336d0e3-0a40-4530-b9f6-576af939c9a9 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.10439a4a-8438-4992-ae4a-8fb07604843d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:56 devstack sudo[104024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7336d0e3-0a40-4530-b9f6-576af939c9a9 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.10439a4a-8438-4992-ae4a-8fb07604843d Nov 06 14:43:56 devstack sudo[104024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:57 devstack sudo[104024]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d9431486-b73c-400c-9701-1fddc8232bdd tempest-SnapshotDependencyTests-262966802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7336d0e3-0a40-4530-b9f6-576af939c9a9 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.10439a4a-8438-4992-ae4a-8fb07604843d" returned: 0 in 0.308s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:57 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-d9431486-b73c-400c-9701-1fddc8232bdd tempest-SnapshotDependencyTests-262966802 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.10439a4a-8438-4992-ae4a-8fb07604843d is being set with open permissions: ugo+rw Nov 06 14:43:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d9431486-b73c-400c-9701-1fddc8232bdd tempest-SnapshotDependencyTests-262966802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.10439a4a-8438-4992-ae4a-8fb07604843d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:57 devstack sudo[104029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.10439a4a-8438-4992-ae4a-8fb07604843d Nov 06 14:43:57 devstack sudo[104029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:57 devstack sudo[104029]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d9431486-b73c-400c-9701-1fddc8232bdd tempest-SnapshotDependencyTests-262966802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.10439a4a-8438-4992-ae4a-8fb07604843d" returned: 0 in 0.242s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d9431486-b73c-400c-9701-1fddc8232bdd tempest-SnapshotDependencyTests-262966802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:57 devstack sudo[104032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.info Nov 06 14:43:57 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:57 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d9431486-b73c-400c-9701-1fddc8232bdd tempest-SnapshotDependencyTests-262966802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.info" returned: 0 in 0.263s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:57 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-d9431486-b73c-400c-9701-1fddc8232bdd tempest-SnapshotDependencyTests-262966802 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.info is being set with open permissions: ugo+rw Nov 06 14:43:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d9431486-b73c-400c-9701-1fddc8232bdd tempest-SnapshotDependencyTests-262966802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:57 devstack sudo[104037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.info Nov 06 14:43:57 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:57 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d9431486-b73c-400c-9701-1fddc8232bdd tempest-SnapshotDependencyTests-262966802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.info" returned: 0 in 0.248s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d9431486-b73c-400c-9701-1fddc8232bdd tempest-SnapshotDependencyTests-262966802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.926s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:57 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-d9431486-b73c-400c-9701-1fddc8232bdd tempest-SnapshotDependencyTests-262966802 None] Create snapshot completed successfully Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Flow 'volume_create_manager' (53907a26-53ab-483f-a69a-87986d929f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b441df2d-37a9-4e19-a31f-e5bcb630d384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b441df2d-37a9-4e19-a31f-e5bcb630d384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a73a61-3fad-4b93-9efe-4ab92a370a7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10cb26eb50740bda5ddf0977b61be4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=10439a4a-8438-4992-ae4a-8fb07604843d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:43:59Z,use_quota=True,user_id='9025e87a3a3146a28642f6ea7ab99548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ab0e01-726d-43b3-bbf7-930305f78f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ab0e01-726d-43b3-bbf7-930305f78f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e5d892-ddd7-4b4b-aaf7-089eda63ac8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e5d892-ddd7-4b4b-aaf7-089eda63ac8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c4a73a61-3fad-4b93-9efe-4ab92a370a7f', 'volume_name': 'volume-c4a73a61-3fad-4b93-9efe-4ab92a370a7f', 'volume_size': 1, 'snapshot_id': '10439a4a-8438-4992-ae4a-8fb07604843d'}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78dfca25-ee74-4576-99d4-2ced4c6db146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78dfca25-ee74-4576-99d4-2ced4c6db146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d20f41c-ff88-4f24-8097-3f72dda4b390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:43:58 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Volume c4a73a61-3fad-4b93-9efe-4ab92a370a7f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c4a73a61-3fad-4b93-9efe-4ab92a370a7f', 'volume_size': 1, 'snapshot_id': '10439a4a-8438-4992-ae4a-8fb07604843d'} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Acquiring lock "cinder-quobyte-10439a4a-8438-4992-ae4a-8fb07604843d-c4a73a61-3fad-4b93-9efe-4ab92a370a7f" by "_create_volume_from_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Lock "cinder-quobyte-10439a4a-8438-4992-ae4a-8fb07604843d-c4a73a61-3fad-4b93-9efe-4ab92a370a7f" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Creating volume c4a73a61-3fad-4b93-9efe-4ab92a370a7f from snapshot 10439a4a-8438-4992-ae4a-8fb07604843d {{(pid=86854) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Acquiring lock "cinder-quobyte-c4a73a61-3fad-4b93-9efe-4ab92a370a7f" by "_copy_volume_from_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Lock "cinder-quobyte-c4a73a61-3fad-4b93-9efe-4ab92a370a7f" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] snapshot: 10439a4a-8438-4992-ae4a-8fb07604843d, volume: c4a73a61-3fad-4b93-9efe-4ab92a370a7f, {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02645f4-16bb-49c2-8b6f-3fc4f6a39679]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:43:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.10439a4a-8438-4992-ae4a-8fb07604843d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:59 devstack sudo[104040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.10439a4a-8438-4992-ae4a-8fb07604843d Nov 06 14:43:59 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:59 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.10439a4a-8438-4992-ae4a-8fb07604843d" returned: 0 in 0.362s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7336d0e3-0a40-4530-b9f6-576af939c9a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:43:59 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ea397b-c7b2-42df-8675-b7a227216387]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:43:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:59 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9 Nov 06 14:43:59 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:43:59 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Nov 06 14:43:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9" returned: 0 in 0.393s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:43:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9 {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 14:43:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Creating direct copy from snapshot {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 14:43:59 devstack cinder-volume[86854]: DEBUG cinder.utils [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Path /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c4a73a61-3fad-4b93-9efe-4ab92a370a7f not found in is_blk_device check {{(pid=86854) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 14:43:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c4a73a61-3fad-4b93-9efe-4ab92a370a7f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:43:59 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c4a73a61-3fad-4b93-9efe-4ab92a370a7f Nov 06 14:43:59 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:06 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c4a73a61-3fad-4b93-9efe-4ab92a370a7f" returned: 0 in 6.500s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:06 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Image conversion details: src /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9, size 1024.00 MB, duration 6.50 sec, destination /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c4a73a61-3fad-4b93-9efe-4ab92a370a7f {{(pid=86854) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 14:44:06 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Converted 1024.00 MB image at 157.50 MB/s Nov 06 14:44:06 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c4a73a61-3fad-4b93-9efe-4ab92a370a7f is being set with open permissions: ugo+rw Nov 06 14:44:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c4a73a61-3fad-4b93-9efe-4ab92a370a7f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:06 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c4a73a61-3fad-4b93-9efe-4ab92a370a7f Nov 06 14:44:06 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:06 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c4a73a61-3fad-4b93-9efe-4ab92a370a7f" returned: 0 in 0.266s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:06 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Lock "cinder-quobyte-c4a73a61-3fad-4b93-9efe-4ab92a370a7f" released by "_copy_volume_from_snapshot" :: held 7.603s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:44:06 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Lock "cinder-quobyte-10439a4a-8438-4992-ae4a-8fb07604843d-c4a73a61-3fad-4b93-9efe-4ab92a370a7f" released by "_create_volume_from_snapshot" :: held 7.670s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:44:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.686s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:44:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d20f41c-ff88-4f24-8097-3f72dda4b390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4a73a61-3fad-4b93-9efe-4ab92a370a7f', 'volume_size': 1, 'snapshot_id': '10439a4a-8438-4992-ae4a-8fb07604843d'}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:44:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54520314-ba17-490b-a187-bced6205861e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:44:06 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Volume volume-c4a73a61-3fad-4b93-9efe-4ab92a370a7f (c4a73a61-3fad-4b93-9efe-4ab92a370a7f): created successfully Nov 06 14:44:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54520314-ba17-490b-a187-bced6205861e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:44:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Flow 'volume_create_manager' (53907a26-53ab-483f-a69a-87986d929f68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:44:06 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-578002d6-6cad-4c05-bed0-85e07477face tempest-SnapshotDependencyTests-262966802 None] Created volume successfully. Nov 06 14:44:07 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8ca5dc55-511a-4edf-9d82-fe44d175e869 tempest-SnapshotDependencyTests-262966802 None] Acquiring lock "cinder-10439a4a-8438-4992-ae4a-8fb07604843d-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:44:07 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8ca5dc55-511a-4edf-9d82-fe44d175e869 tempest-SnapshotDependencyTests-262966802 None] Lock "cinder-10439a4a-8438-4992-ae4a-8fb07604843d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:44:07 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8ca5dc55-511a-4edf-9d82-fe44d175e869 tempest-SnapshotDependencyTests-262966802 None] Acquiring lock "cinder-quobyte-7336d0e3-0a40-4530-b9f6-576af939c9a9" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:44:07 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8ca5dc55-511a-4edf-9d82-fe44d175e869 tempest-SnapshotDependencyTests-262966802 None] Lock "cinder-quobyte-7336d0e3-0a40-4530-b9f6-576af939c9a9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:44:07 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8ca5dc55-511a-4edf-9d82-fe44d175e869 tempest-SnapshotDependencyTests-262966802 None] Acquiring lock "cinder-quobyte-10439a4a-8438-4992-ae4a-8fb07604843d" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:44:07 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8ca5dc55-511a-4edf-9d82-fe44d175e869 tempest-SnapshotDependencyTests-262966802 None] Lock "cinder-quobyte-10439a4a-8438-4992-ae4a-8fb07604843d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:44:07 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-8ca5dc55-511a-4edf-9d82-fe44d175e869 tempest-SnapshotDependencyTests-262966802 None] Deleting offline snapshot 10439a4a-8438-4992-ae4a-8fb07604843d of volume 7336d0e3-0a40-4530-b9f6-576af939c9a9 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:44:07 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-8ca5dc55-511a-4edf-9d82-fe44d175e869 tempest-SnapshotDependencyTests-262966802 None] snapshot_file for this snap is: volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.10439a4a-8438-4992-ae4a-8fb07604843d {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:44:07 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[79715f91-b55b-4aa1-9daf-104a70aec037]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:44:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8ca5dc55-511a-4edf-9d82-fe44d175e869 tempest-SnapshotDependencyTests-262966802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.10439a4a-8438-4992-ae4a-8fb07604843d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:07 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.10439a4a-8438-4992-ae4a-8fb07604843d Nov 06 14:44:07 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:07 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8ca5dc55-511a-4edf-9d82-fe44d175e869 tempest-SnapshotDependencyTests-262966802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.10439a4a-8438-4992-ae4a-8fb07604843d" returned: 0 in 0.361s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:07 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-8ca5dc55-511a-4edf-9d82-fe44d175e869 tempest-SnapshotDependencyTests-262966802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7336d0e3-0a40-4530-b9f6-576af939c9a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:44:07 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0af2089-a9a8-48bd-afc9-3b158d91c77e]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:44:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8ca5dc55-511a-4edf-9d82-fe44d175e869 tempest-SnapshotDependencyTests-262966802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:08 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9 Nov 06 14:44:08 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:08 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8ca5dc55-511a-4edf-9d82-fe44d175e869 tempest-SnapshotDependencyTests-262966802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9" returned: 0 in 0.532s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8ca5dc55-511a-4edf-9d82-fe44d175e869 tempest-SnapshotDependencyTests-262966802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.10439a4a-8438-4992-ae4a-8fb07604843d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:08 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.10439a4a-8438-4992-ae4a-8fb07604843d Nov 06 14:44:08 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:08 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8ca5dc55-511a-4edf-9d82-fe44d175e869 tempest-SnapshotDependencyTests-262966802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.10439a4a-8438-4992-ae4a-8fb07604843d" returned: 0 in 0.323s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8ca5dc55-511a-4edf-9d82-fe44d175e869 tempest-SnapshotDependencyTests-262966802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.10439a4a-8438-4992-ae4a-8fb07604843d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:08 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.10439a4a-8438-4992-ae4a-8fb07604843d Nov 06 14:44:08 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:09 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8ca5dc55-511a-4edf-9d82-fe44d175e869 tempest-SnapshotDependencyTests-262966802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9.10439a4a-8438-4992-ae4a-8fb07604843d" returned: 0 in 0.237s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8ca5dc55-511a-4edf-9d82-fe44d175e869 tempest-SnapshotDependencyTests-262966802 None] Lock "cinder-quobyte-10439a4a-8438-4992-ae4a-8fb07604843d" released by "_delete_snapshot" :: held 1.572s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:44:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8ca5dc55-511a-4edf-9d82-fe44d175e869 tempest-SnapshotDependencyTests-262966802 None] Lock "cinder-quobyte-7336d0e3-0a40-4530-b9f6-576af939c9a9" released by "delete_snapshot" :: held 1.595s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:44:09 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-8ca5dc55-511a-4edf-9d82-fe44d175e869 tempest-SnapshotDependencyTests-262966802 None] Created reservations ['5b5c9c80-d027-457a-85c8-d3b8d24e053a', '7673a44e-593a-4948-a46c-511be0238692', '3d7eb464-9aab-442b-ac93-538abba461c9', '3a6769bc-f66a-4171-91d0-6ed71c450a38'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:44:09 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-8ca5dc55-511a-4edf-9d82-fe44d175e869 tempest-SnapshotDependencyTests-262966802 None] Delete snapshot completed successfully. Nov 06 14:44:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8ca5dc55-511a-4edf-9d82-fe44d175e869 tempest-SnapshotDependencyTests-262966802 None] Lock "cinder-10439a4a-8438-4992-ae4a-8fb07604843d-delete_snapshot" released by "delete_snapshot" :: held 1.718s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:44:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-293d15f0-fde7-4b17-9d70-81400bb026e5 tempest-SnapshotDependencyTests-262966802 None] Acquiring lock "cinder-7336d0e3-0a40-4530-b9f6-576af939c9a9-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:44:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-293d15f0-fde7-4b17-9d70-81400bb026e5 tempest-SnapshotDependencyTests-262966802 None] Lock "cinder-7336d0e3-0a40-4530-b9f6-576af939c9a9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:44:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-293d15f0-fde7-4b17-9d70-81400bb026e5 tempest-SnapshotDependencyTests-262966802 None] Acquiring lock "cinder-quobyte-7336d0e3-0a40-4530-b9f6-576af939c9a9" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:44:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-293d15f0-fde7-4b17-9d70-81400bb026e5 tempest-SnapshotDependencyTests-262966802 None] Lock "cinder-quobyte-7336d0e3-0a40-4530-b9f6-576af939c9a9" acquired by "delete_volume" :: waited 0.016s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:44:09 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f8ba69-f5b4-418a-b0f5-c66fa683db09]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:44:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-293d15f0-fde7-4b17-9d70-81400bb026e5 tempest-SnapshotDependencyTests-262966802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:09 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9 Nov 06 14:44:09 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:10 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-293d15f0-fde7-4b17-9d70-81400bb026e5 tempest-SnapshotDependencyTests-262966802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9" returned: 0 in 0.355s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-293d15f0-fde7-4b17-9d70-81400bb026e5 tempest-SnapshotDependencyTests-262966802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:10 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9 Nov 06 14:44:10 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:10 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-293d15f0-fde7-4b17-9d70-81400bb026e5 tempest-SnapshotDependencyTests-262966802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7336d0e3-0a40-4530-b9f6-576af939c9a9" returned: 0 in 0.242s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:10 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-293d15f0-fde7-4b17-9d70-81400bb026e5 tempest-SnapshotDependencyTests-262966802 None] Lock "cinder-quobyte-7336d0e3-0a40-4530-b9f6-576af939c9a9" released by "delete_volume" :: held 0.655s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:44:10 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-293d15f0-fde7-4b17-9d70-81400bb026e5 tempest-SnapshotDependencyTests-262966802 None] Created reservations ['fe6bc07f-f092-4ac1-8559-145d98f44afc', '349417bc-eaa6-41fd-abd9-34d46c6ca010', '99956da2-69d6-49b7-9684-372e186ac612', 'ab5b54bc-5d14-43eb-8fd1-6a0a456eaf67'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:44:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-293d15f0-fde7-4b17-9d70-81400bb026e5 tempest-SnapshotDependencyTests-262966802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:44:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-293d15f0-fde7-4b17-9d70-81400bb026e5 tempest-SnapshotDependencyTests-262966802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:44:10 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-293d15f0-fde7-4b17-9d70-81400bb026e5 tempest-SnapshotDependencyTests-262966802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:44:10 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-293d15f0-fde7-4b17-9d70-81400bb026e5 tempest-SnapshotDependencyTests-262966802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:44:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-293d15f0-fde7-4b17-9d70-81400bb026e5 tempest-SnapshotDependencyTests-262966802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:44:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-293d15f0-fde7-4b17-9d70-81400bb026e5 tempest-SnapshotDependencyTests-262966802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:10 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:44:10 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:10 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-293d15f0-fde7-4b17-9d70-81400bb026e5 tempest-SnapshotDependencyTests-262966802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.246s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:10 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-293d15f0-fde7-4b17-9d70-81400bb026e5 tempest-SnapshotDependencyTests-262966802 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:44:10 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-293d15f0-fde7-4b17-9d70-81400bb026e5 tempest-SnapshotDependencyTests-262966802 None] Deleted volume successfully. Nov 06 14:44:10 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-293d15f0-fde7-4b17-9d70-81400bb026e5 tempest-SnapshotDependencyTests-262966802 None] Lock "cinder-7336d0e3-0a40-4530-b9f6-576af939c9a9-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:44:10 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-76d58f37-c18c-4333-849e-77d7d3833036 tempest-SnapshotDependencyTests-262966802 None] Acquiring lock "cinder-c4a73a61-3fad-4b93-9efe-4ab92a370a7f-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:44:10 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-76d58f37-c18c-4333-849e-77d7d3833036 tempest-SnapshotDependencyTests-262966802 None] Lock "cinder-c4a73a61-3fad-4b93-9efe-4ab92a370a7f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:44:10 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-76d58f37-c18c-4333-849e-77d7d3833036 tempest-SnapshotDependencyTests-262966802 None] Acquiring lock "cinder-quobyte-c4a73a61-3fad-4b93-9efe-4ab92a370a7f" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:44:10 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-76d58f37-c18c-4333-849e-77d7d3833036 tempest-SnapshotDependencyTests-262966802 None] Lock "cinder-quobyte-c4a73a61-3fad-4b93-9efe-4ab92a370a7f" acquired by "delete_volume" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:44:10 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2b74a4-e96c-4dea-9906-6d539b8592e1]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:44:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-76d58f37-c18c-4333-849e-77d7d3833036 tempest-SnapshotDependencyTests-262966802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c4a73a61-3fad-4b93-9efe-4ab92a370a7f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:11 devstack sudo[104110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c4a73a61-3fad-4b93-9efe-4ab92a370a7f Nov 06 14:44:11 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:11 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-76d58f37-c18c-4333-849e-77d7d3833036 tempest-SnapshotDependencyTests-262966802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c4a73a61-3fad-4b93-9efe-4ab92a370a7f" returned: 0 in 0.356s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-76d58f37-c18c-4333-849e-77d7d3833036 tempest-SnapshotDependencyTests-262966802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c4a73a61-3fad-4b93-9efe-4ab92a370a7f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:11 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c4a73a61-3fad-4b93-9efe-4ab92a370a7f Nov 06 14:44:11 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:11 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-76d58f37-c18c-4333-849e-77d7d3833036 tempest-SnapshotDependencyTests-262966802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c4a73a61-3fad-4b93-9efe-4ab92a370a7f" returned: 0 in 0.254s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-76d58f37-c18c-4333-849e-77d7d3833036 tempest-SnapshotDependencyTests-262966802 None] Lock "cinder-quobyte-c4a73a61-3fad-4b93-9efe-4ab92a370a7f" released by "delete_volume" :: held 0.653s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:44:11 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-76d58f37-c18c-4333-849e-77d7d3833036 tempest-SnapshotDependencyTests-262966802 None] Created reservations ['0aaeaaea-a0e2-4c01-9a14-ad75cb5f28a2', 'e41ccd04-99d4-4d09-89d0-fa93cd1a00fd', '613b46d1-681e-468a-92bd-b223062da2cf', 'c7ca363a-a572-43cb-8c50-1434e50c9233'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:44:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-76d58f37-c18c-4333-849e-77d7d3833036 tempest-SnapshotDependencyTests-262966802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:44:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-76d58f37-c18c-4333-849e-77d7d3833036 tempest-SnapshotDependencyTests-262966802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:44:11 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-76d58f37-c18c-4333-849e-77d7d3833036 tempest-SnapshotDependencyTests-262966802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:44:11 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-76d58f37-c18c-4333-849e-77d7d3833036 tempest-SnapshotDependencyTests-262966802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:44:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-76d58f37-c18c-4333-849e-77d7d3833036 tempest-SnapshotDependencyTests-262966802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:44:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-76d58f37-c18c-4333-849e-77d7d3833036 tempest-SnapshotDependencyTests-262966802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:11 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:44:11 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:11 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-76d58f37-c18c-4333-849e-77d7d3833036 tempest-SnapshotDependencyTests-262966802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.250s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:11 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-76d58f37-c18c-4333-849e-77d7d3833036 tempest-SnapshotDependencyTests-262966802 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:44:11 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-76d58f37-c18c-4333-849e-77d7d3833036 tempest-SnapshotDependencyTests-262966802 None] Deleted volume successfully. Nov 06 14:44:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-76d58f37-c18c-4333-849e-77d7d3833036 tempest-SnapshotDependencyTests-262966802 None] Lock "cinder-c4a73a61-3fad-4b93-9efe-4ab92a370a7f-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:44:21 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:UPDATE=39,cinder:SELECT=20,cinder:DELETE=5,cinder:INSERT=9 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:44:21 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=32,cinder:INSERT=7,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:44:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:44:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:44:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:44:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:44:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:44:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:44:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:23 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:44:23 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:23 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.254s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:23 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:44:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager._thread_info {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:44:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread count: 28 {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 14:44:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread info: [<_MainThread(MainThread, started 130306900594816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 14:44:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-833f2d90-5670-4729-9643-173b0e3920ff req-699eb6fd-abf4-4ee7-a5d4-307b838aebf2 tempest-TestStampPattern-100495455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:44:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-833f2d90-5670-4729-9643-173b0e3920ff req-699eb6fd-abf4-4ee7-a5d4-307b838aebf2 tempest-TestStampPattern-100495455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:44:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [req-833f2d90-5670-4729-9643-173b0e3920ff req-699eb6fd-abf4-4ee7-a5d4-307b838aebf2 tempest-TestStampPattern-100495455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:44:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-833f2d90-5670-4729-9643-173b0e3920ff req-699eb6fd-abf4-4ee7-a5d4-307b838aebf2 tempest-TestStampPattern-100495455 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e', 'name': 'volume-e07250ad-2b77-473a-ac32-24968dbe45f7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '92945ad5-a408-4d6c-b6bf-a28dd499d1d3', 'enforce_multipath': True} {{(pid=86854) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 14:44:29 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-833f2d90-5670-4729-9643-173b0e3920ff req-699eb6fd-abf4-4ee7-a5d4-307b838aebf2 tempest-TestStampPattern-100495455 None] attachment_update completed successfully. Nov 06 14:44:31 devstack cinder-volume[86854]: INFO cinder.volume.manager [req-f3453140-9907-4f41-874e-23917ee7a1f9 req-f44bb4ab-91c7-42ca-9f65-12a02722198f tempest-TestStampPattern-100495455 None] Terminate volume connection completed successfully. Nov 06 14:44:31 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [req-f3453140-9907-4f41-874e-23917ee7a1f9 req-f44bb4ab-91c7-42ca-9f65-12a02722198f tempest-TestStampPattern-100495455 None] Deleting attachment 92945ad5-a408-4d6c-b6bf-a28dd499d1d3. {{(pid=86854) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 14:44:36 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-85146f5d-de12-4ac3-a9e2-51118348bbc0 tempest-TestStampPattern-100495455 None] Acquiring lock "cinder-e07250ad-2b77-473a-ac32-24968dbe45f7-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:44:36 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-85146f5d-de12-4ac3-a9e2-51118348bbc0 tempest-TestStampPattern-100495455 None] Lock "cinder-e07250ad-2b77-473a-ac32-24968dbe45f7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:44:36 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-85146f5d-de12-4ac3-a9e2-51118348bbc0 tempest-TestStampPattern-100495455 None] Acquiring lock "cinder-quobyte-e07250ad-2b77-473a-ac32-24968dbe45f7" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:44:36 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-85146f5d-de12-4ac3-a9e2-51118348bbc0 tempest-TestStampPattern-100495455 None] Lock "cinder-quobyte-e07250ad-2b77-473a-ac32-24968dbe45f7" acquired by "delete_volume" :: waited 0.014s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:44:36 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[b559bf82-f7a6-431f-bf57-388661b0fa59]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:44:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-85146f5d-de12-4ac3-a9e2-51118348bbc0 tempest-TestStampPattern-100495455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e07250ad-2b77-473a-ac32-24968dbe45f7 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:36 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e07250ad-2b77-473a-ac32-24968dbe45f7 Nov 06 14:44:36 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:36 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-85146f5d-de12-4ac3-a9e2-51118348bbc0 tempest-TestStampPattern-100495455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e07250ad-2b77-473a-ac32-24968dbe45f7" returned: 0 in 0.356s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-85146f5d-de12-4ac3-a9e2-51118348bbc0 tempest-TestStampPattern-100495455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e07250ad-2b77-473a-ac32-24968dbe45f7 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:36 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e07250ad-2b77-473a-ac32-24968dbe45f7 Nov 06 14:44:36 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:36 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-85146f5d-de12-4ac3-a9e2-51118348bbc0 tempest-TestStampPattern-100495455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e07250ad-2b77-473a-ac32-24968dbe45f7" returned: 0 in 0.248s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:36 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-85146f5d-de12-4ac3-a9e2-51118348bbc0 tempest-TestStampPattern-100495455 None] Lock "cinder-quobyte-e07250ad-2b77-473a-ac32-24968dbe45f7" released by "delete_volume" :: held 0.645s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:44:36 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-85146f5d-de12-4ac3-a9e2-51118348bbc0 tempest-TestStampPattern-100495455 None] Created reservations ['626291ce-f335-4dc2-a273-adeb05c46ba6', '9c9a6dd1-c2bc-4f0e-a536-49843f7746f8', '0d5d5c4e-8a6d-46e4-818e-0df536a560a7', '57452395-b694-4bf0-b175-9ec229a4d40a'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:44:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-85146f5d-de12-4ac3-a9e2-51118348bbc0 tempest-TestStampPattern-100495455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:44:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-85146f5d-de12-4ac3-a9e2-51118348bbc0 tempest-TestStampPattern-100495455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:44:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-85146f5d-de12-4ac3-a9e2-51118348bbc0 tempest-TestStampPattern-100495455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:44:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-85146f5d-de12-4ac3-a9e2-51118348bbc0 tempest-TestStampPattern-100495455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:44:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-85146f5d-de12-4ac3-a9e2-51118348bbc0 tempest-TestStampPattern-100495455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:44:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-85146f5d-de12-4ac3-a9e2-51118348bbc0 tempest-TestStampPattern-100495455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:36 devstack sudo[104690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:44:36 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:37 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-85146f5d-de12-4ac3-a9e2-51118348bbc0 tempest-TestStampPattern-100495455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.233s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:37 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-85146f5d-de12-4ac3-a9e2-51118348bbc0 tempest-TestStampPattern-100495455 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:44:37 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-85146f5d-de12-4ac3-a9e2-51118348bbc0 tempest-TestStampPattern-100495455 None] Deleted volume successfully. Nov 06 14:44:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-85146f5d-de12-4ac3-a9e2-51118348bbc0 tempest-TestStampPattern-100495455 None] Lock "cinder-e07250ad-2b77-473a-ac32-24968dbe45f7-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:44:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3fa9c400-20c0-4f3a-b4ae-c34d96b19e38 tempest-TestStampPattern-100495455 None] Acquiring lock "cinder-83d73b21-e30f-4f80-bf61-590d10df8243-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:44:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3fa9c400-20c0-4f3a-b4ae-c34d96b19e38 tempest-TestStampPattern-100495455 None] Lock "cinder-83d73b21-e30f-4f80-bf61-590d10df8243-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:44:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3fa9c400-20c0-4f3a-b4ae-c34d96b19e38 tempest-TestStampPattern-100495455 None] Acquiring lock "cinder-quobyte-d9a19d1e-a571-427b-a7eb-437485b6be6a" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:44:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3fa9c400-20c0-4f3a-b4ae-c34d96b19e38 tempest-TestStampPattern-100495455 None] Lock "cinder-quobyte-d9a19d1e-a571-427b-a7eb-437485b6be6a" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:44:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3fa9c400-20c0-4f3a-b4ae-c34d96b19e38 tempest-TestStampPattern-100495455 None] Acquiring lock "cinder-quobyte-83d73b21-e30f-4f80-bf61-590d10df8243" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:44:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3fa9c400-20c0-4f3a-b4ae-c34d96b19e38 tempest-TestStampPattern-100495455 None] Lock "cinder-quobyte-83d73b21-e30f-4f80-bf61-590d10df8243" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:44:37 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-3fa9c400-20c0-4f3a-b4ae-c34d96b19e38 tempest-TestStampPattern-100495455 None] Deleting offline snapshot 83d73b21-e30f-4f80-bf61-590d10df8243 of volume d9a19d1e-a571-427b-a7eb-437485b6be6a {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:44:37 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-3fa9c400-20c0-4f3a-b4ae-c34d96b19e38 tempest-TestStampPattern-100495455 None] snapshot_file for this snap is: volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.83d73b21-e30f-4f80-bf61-590d10df8243 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:44:37 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8b9a70-44e3-4594-a745-d1eadea386c1]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:44:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3fa9c400-20c0-4f3a-b4ae-c34d96b19e38 tempest-TestStampPattern-100495455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.83d73b21-e30f-4f80-bf61-590d10df8243 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:37 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.83d73b21-e30f-4f80-bf61-590d10df8243 Nov 06 14:44:37 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:37 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3fa9c400-20c0-4f3a-b4ae-c34d96b19e38 tempest-TestStampPattern-100495455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.83d73b21-e30f-4f80-bf61-590d10df8243" returned: 0 in 0.363s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:37 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-3fa9c400-20c0-4f3a-b4ae-c34d96b19e38 tempest-TestStampPattern-100495455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9a19d1e-a571-427b-a7eb-437485b6be6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:44:37 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b7cf44-14ff-4f04-88de-a63b4514d7c8]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:44:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3fa9c400-20c0-4f3a-b4ae-c34d96b19e38 tempest-TestStampPattern-100495455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:38 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a Nov 06 14:44:38 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:38 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3fa9c400-20c0-4f3a-b4ae-c34d96b19e38 tempest-TestStampPattern-100495455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a" returned: 0 in 0.495s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3fa9c400-20c0-4f3a-b4ae-c34d96b19e38 tempest-TestStampPattern-100495455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.83d73b21-e30f-4f80-bf61-590d10df8243 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:38 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.83d73b21-e30f-4f80-bf61-590d10df8243 Nov 06 14:44:38 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:38 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3fa9c400-20c0-4f3a-b4ae-c34d96b19e38 tempest-TestStampPattern-100495455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.83d73b21-e30f-4f80-bf61-590d10df8243" returned: 0 in 0.322s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3fa9c400-20c0-4f3a-b4ae-c34d96b19e38 tempest-TestStampPattern-100495455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.83d73b21-e30f-4f80-bf61-590d10df8243 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:38 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.83d73b21-e30f-4f80-bf61-590d10df8243 Nov 06 14:44:38 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:38 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3fa9c400-20c0-4f3a-b4ae-c34d96b19e38 tempest-TestStampPattern-100495455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a.83d73b21-e30f-4f80-bf61-590d10df8243" returned: 0 in 0.246s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:39 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3fa9c400-20c0-4f3a-b4ae-c34d96b19e38 tempest-TestStampPattern-100495455 None] Lock "cinder-quobyte-83d73b21-e30f-4f80-bf61-590d10df8243" released by "_delete_snapshot" :: held 1.559s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:44:39 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3fa9c400-20c0-4f3a-b4ae-c34d96b19e38 tempest-TestStampPattern-100495455 None] Lock "cinder-quobyte-d9a19d1e-a571-427b-a7eb-437485b6be6a" released by "delete_snapshot" :: held 1.581s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:44:39 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-3fa9c400-20c0-4f3a-b4ae-c34d96b19e38 tempest-TestStampPattern-100495455 None] Created reservations ['e315ca05-1bf7-4f70-958b-c9da659ff24b', '9fe7b94f-f944-4724-8c8e-3905309c1c40', 'fb2e507f-da24-45c0-be06-30a6b80cd4d5', 'c369f30a-be90-4c90-b174-064b07bb4593'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:44:39 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-3fa9c400-20c0-4f3a-b4ae-c34d96b19e38 tempest-TestStampPattern-100495455 None] Delete snapshot completed successfully. Nov 06 14:44:39 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3fa9c400-20c0-4f3a-b4ae-c34d96b19e38 tempest-TestStampPattern-100495455 None] Lock "cinder-83d73b21-e30f-4f80-bf61-590d10df8243-delete_snapshot" released by "delete_snapshot" :: held 1.742s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:44:42 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a735632f-4fe1-457b-adfc-a0ec88f1709b tempest-TestStampPattern-100495455 None] Acquiring lock "cinder-d9a19d1e-a571-427b-a7eb-437485b6be6a-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:44:42 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a735632f-4fe1-457b-adfc-a0ec88f1709b tempest-TestStampPattern-100495455 None] Lock "cinder-d9a19d1e-a571-427b-a7eb-437485b6be6a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:44:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a735632f-4fe1-457b-adfc-a0ec88f1709b tempest-TestStampPattern-100495455 None] Acquiring lock "cinder-quobyte-d9a19d1e-a571-427b-a7eb-437485b6be6a" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:44:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a735632f-4fe1-457b-adfc-a0ec88f1709b tempest-TestStampPattern-100495455 None] Lock "cinder-quobyte-d9a19d1e-a571-427b-a7eb-437485b6be6a" acquired by "delete_volume" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:44:43 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b729c86-e981-4529-8e2b-5582cfdc2578]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:44:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a735632f-4fe1-457b-adfc-a0ec88f1709b tempest-TestStampPattern-100495455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:43 devstack sudo[104740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a Nov 06 14:44:43 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:43 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a735632f-4fe1-457b-adfc-a0ec88f1709b tempest-TestStampPattern-100495455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a" returned: 0 in 0.349s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a735632f-4fe1-457b-adfc-a0ec88f1709b tempest-TestStampPattern-100495455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:43 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a Nov 06 14:44:43 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:43 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a735632f-4fe1-457b-adfc-a0ec88f1709b tempest-TestStampPattern-100495455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d9a19d1e-a571-427b-a7eb-437485b6be6a" returned: 0 in 0.243s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a735632f-4fe1-457b-adfc-a0ec88f1709b tempest-TestStampPattern-100495455 None] Lock "cinder-quobyte-d9a19d1e-a571-427b-a7eb-437485b6be6a" released by "delete_volume" :: held 0.655s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:44:43 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-a735632f-4fe1-457b-adfc-a0ec88f1709b tempest-TestStampPattern-100495455 None] Created reservations ['fb6a8159-ea24-4c26-a7a2-d2417f03525a', 'e3cc2800-ce26-419b-85fb-406565d1b989', 'a55953c4-c4f4-415a-84fe-a3ef7cbd06e1', '8324e9d4-d6e1-4411-a7c6-4d8fc2768573'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:44:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a735632f-4fe1-457b-adfc-a0ec88f1709b tempest-TestStampPattern-100495455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:44:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a735632f-4fe1-457b-adfc-a0ec88f1709b tempest-TestStampPattern-100495455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:44:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a735632f-4fe1-457b-adfc-a0ec88f1709b tempest-TestStampPattern-100495455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:44:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a735632f-4fe1-457b-adfc-a0ec88f1709b tempest-TestStampPattern-100495455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:44:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a735632f-4fe1-457b-adfc-a0ec88f1709b tempest-TestStampPattern-100495455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:44:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a735632f-4fe1-457b-adfc-a0ec88f1709b tempest-TestStampPattern-100495455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:43 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:44:43 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:44 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a735632f-4fe1-457b-adfc-a0ec88f1709b tempest-TestStampPattern-100495455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.235s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:44 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-a735632f-4fe1-457b-adfc-a0ec88f1709b tempest-TestStampPattern-100495455 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:44:44 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-a735632f-4fe1-457b-adfc-a0ec88f1709b tempest-TestStampPattern-100495455 None] Deleted volume successfully. Nov 06 14:44:44 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a735632f-4fe1-457b-adfc-a0ec88f1709b tempest-TestStampPattern-100495455 None] Lock "cinder-d9a19d1e-a571-427b-a7eb-437485b6be6a-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:44:53 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=23,cinder:UPDATE=23,cinder:INSERT=5 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:44:54 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=23,cinder:UPDATE=23,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:44:57 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:44:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Flow 'volume_create_manager' (fa67adbc-5bcb-4aa8-a461-17326ca6b9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:44:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e326aa4f-59c4-407d-ae69-b6fd7c37cd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:44:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e326aa4f-59c4-407d-ae69-b6fd7c37cd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9818853-ea86-4e85-87fc-46e1f5bbb95a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b663a8837d22419aab2d533777b78363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:44:57Z,use_quota=True,user_id='cdbfbf795234499b9660a6babf378b07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:44:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6cf5b49-95e3-4603-8fba-3c9d4433b1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:44:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6cf5b49-95e3-4603-8fba-3c9d4433b1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:44:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c126f7c1-9bbc-4d67-9e81-8eb59aa4968b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:44:57 devstack cinder-volume[86854]: DEBUG cinder.image.glance [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Creating Keystone auth plugin from conf {{(pid=86854) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 14:44:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c126f7c1-9bbc-4d67-9e81-8eb59aa4968b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e9818853-ea86-4e85-87fc-46e1f5bbb95a', 'volume_name': 'volume-e9818853-ea86-4e85-87fc-46e1f5bbb95a', 'volume_size': 1, 'image_id': '5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd25130bd6e606d3cb330652541955dfe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b663a8837d22419aab2d533777b78363', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '582a0b9a56a160fadf515bebf45992b0709dfc1e19a14c422c443fc7034832172241bbb6cb22292b7a316998a81b4f07128d88db77296caa68b12ed1eb33998a', 'id': '5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7', 'created_at': datetime.datetime(2026, 11, 6, 13, 44, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 44, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7/file', 'properties': {}}, 'image_service': }' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:44:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3dc11a4-2b9c-478b-ab93-fb33d9f3c7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:44:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3dc11a4-2b9c-478b-ab93-fb33d9f3c7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:44:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (134041d3-ec7c-4365-9a46-beb53ba0375e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:44:57 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Volume e9818853-ea86-4e85-87fc-46e1f5bbb95a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e9818853-ea86-4e85-87fc-46e1f5bbb95a', 'volume_size': 1, 'image_id': '5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd25130bd6e606d3cb330652541955dfe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b663a8837d22419aab2d533777b78363', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '582a0b9a56a160fadf515bebf45992b0709dfc1e19a14c422c443fc7034832172241bbb6cb22292b7a316998a81b4f07128d88db77296caa68b12ed1eb33998a', 'id': '5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7', 'created_at': datetime.datetime(2026, 11, 6, 13, 44, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 44, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7/file', 'properties': {}}, 'image_service': } Nov 06 14:44:57 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Trying to clone e9818853-ea86-4e85-87fc-46e1f5bbb95a from image 5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7', 'metadata': {}}]). {{(pid=86854) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 14:44:57 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_ply9kpsbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 14:44:57 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Image download 0.00 MB at 0.00 MB/s Nov 06 14:44:57 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8fdebc-c3d3-40d5-b439-d41bdead0953]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:44:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_ply9kpsbdevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:57 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_ply9kpsbdevstack@QuobyteHD Nov 06 14:44:57 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:57 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_ply9kpsbdevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_ply9kpsbdevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:57 devstack sudo[104763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_ply9kpsbdevstack@QuobyteHD Nov 06 14:44:57 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:58 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_ply9kpsbdevstack@QuobyteHD" returned: 1 in 0.312s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_ply9kpsbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 14:44:58 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Temporary image 5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7 is fetched for user cdbfbf795234499b9660a6babf378b07. {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 14:44:58 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c6681d-0a22-4a4e-aab3-a562c2621765]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:44:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_ply9kpsbdevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:58 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_ply9kpsbdevstack@QuobyteHD Nov 06 14:44:58 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:58 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_ply9kpsbdevstack@QuobyteHD" returned: 0 in 0.318s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_ply9kpsbdevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:58 devstack sudo[104772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_ply9kpsbdevstack@QuobyteHD Nov 06 14:44:58 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:58 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_ply9kpsbdevstack@QuobyteHD" returned: 1 in 0.318s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_ply9kpsbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 14:44:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:44:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:44:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9818853-ea86-4e85-87fc-46e1f5bbb95a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b663a8837d22419aab2d533777b78363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:44:57Z,use_quota=True,user_id='cdbfbf795234499b9660a6babf378b07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:44:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Creating volume e9818853-ea86-4e85-87fc-46e1f5bbb95a {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:44:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:44:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:44:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:44:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:44:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:44:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:44:58 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:44:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9818853-ea86-4e85-87fc-46e1f5bbb95a 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:58 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9818853-ea86-4e85-87fc-46e1f5bbb95a 1073741824 Nov 06 14:44:58 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:59 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9818853-ea86-4e85-87fc-46e1f5bbb95a 1073741824" returned: 0 in 0.415s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9818853-ea86-4e85-87fc-46e1f5bbb95a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:59 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9818853-ea86-4e85-87fc-46e1f5bbb95a Nov 06 14:44:59 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:59 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9818853-ea86-4e85-87fc-46e1f5bbb95a" returned: 0 in 0.237s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:44:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:44:59 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Attempting download of 5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7 ((None, [{'url': 'file:///opt/stack/data/glance/images/5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7', 'metadata': {}}])) to volume e9818853-ea86-4e85-87fc-46e1f5bbb95a. {{(pid=86854) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 14:44:59 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[be08bb99-8d47-4e00-b04d-5deceb1aa5a4]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:44:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_eh78pz6f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:59 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_eh78pz6f Nov 06 14:44:59 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:44:59 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Nov 06 14:44:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_eh78pz6f" returned: 0 in 0.320s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:44:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_eh78pz6f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:44:59 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_eh78pz6f Nov 06 14:44:59 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:00 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_eh78pz6f" returned: 1 in 0.316s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_eh78pz6f' failed. Not Retrying. {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 14:45:00 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0ff7e2-90f5-47d1-9cd7-0584bc569d3b]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:45:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_ply9kpsbdevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:00 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_ply9kpsbdevstack@QuobyteHD Nov 06 14:45:00 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:00 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_ply9kpsbdevstack@QuobyteHD" returned: 0 in 0.321s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_ply9kpsbdevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:00 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_ply9kpsbdevstack@QuobyteHD Nov 06 14:45:00 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:00 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_ply9kpsbdevstack@QuobyteHD" returned: 1 in 0.317s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_ply9kpsbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 14:45:00 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] 5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7 was raw, converting to qcow2 {{(pid=86854) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 14:45:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_ply9kpsbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9818853-ea86-4e85-87fc-46e1f5bbb95a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:00 devstack sudo[104803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_ply9kpsbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9818853-ea86-4e85-87fc-46e1f5bbb95a Nov 06 14:45:00 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:01 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_ply9kpsbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9818853-ea86-4e85-87fc-46e1f5bbb95a" returned: 0 in 0.423s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:01 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7_ply9kpsbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9818853-ea86-4e85-87fc-46e1f5bbb95a {{(pid=86854) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 14:45:01 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 14:45:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9818853-ea86-4e85-87fc-46e1f5bbb95a 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:01 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9818853-ea86-4e85-87fc-46e1f5bbb95a 1G Nov 06 14:45:01 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:01 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9818853-ea86-4e85-87fc-46e1f5bbb95a 1G" returned: 0 in 0.304s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:01 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Downloaded image 5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7 ((None, [{'url': 'file:///opt/stack/data/glance/images/5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7', 'metadata': {}}])) to volume e9818853-ea86-4e85-87fc-46e1f5bbb95a successfully. {{(pid=86854) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 14:45:01 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Temporary image 5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7 for user cdbfbf795234499b9660a6babf378b07 is deleted. {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 14:45:01 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Marking volume e9818853-ea86-4e85-87fc-46e1f5bbb95a as bootable. {{(pid=86854) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 14:45:01 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Copying metadata from image 5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7 to e9818853-ea86-4e85-87fc-46e1f5bbb95a. {{(pid=86854) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 14:45:01 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Creating volume glance metadata for volume e9818853-ea86-4e85-87fc-46e1f5bbb95a backed by image 5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7 with: {'image_id': '5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd25130bd6e606d3cb330652541955dfe', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86854) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 14:45:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (134041d3-ec7c-4365-9a46-beb53ba0375e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9818853-ea86-4e85-87fc-46e1f5bbb95a', 'volume_size': 1, 'image_id': '5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd25130bd6e606d3cb330652541955dfe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b663a8837d22419aab2d533777b78363', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '582a0b9a56a160fadf515bebf45992b0709dfc1e19a14c422c443fc7034832172241bbb6cb22292b7a316998a81b4f07128d88db77296caa68b12ed1eb33998a', 'id': '5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7', 'created_at': datetime.datetime(2026, 11, 6, 13, 44, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 44, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a70ecc6-46c2-4b6f-88ea-5f54a38ceab7/file', 'properties': {}}, 'image_service': }' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f7f721-ff5b-458b-9ac1-d39679fc4ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:01 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Volume volume-e9818853-ea86-4e85-87fc-46e1f5bbb95a (e9818853-ea86-4e85-87fc-46e1f5bbb95a): created successfully Nov 06 14:45:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f7f721-ff5b-458b-9ac1-d39679fc4ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Flow 'volume_create_manager' (fa67adbc-5bcb-4aa8-a461-17326ca6b9cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:01 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-5f5ec883-21c7-43dd-9692-8f3d24813940 tempest-VolumeImageDependencyTests-1874823607 None] Created volume successfully. Nov 06 14:45:02 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c44f0ad8-6a21-41de-9e93-910ddfc0d482 tempest-VolumeImageDependencyTests-1874823607 None] Acquiring lock "cinder-e9818853-ea86-4e85-87fc-46e1f5bbb95a-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:02 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c44f0ad8-6a21-41de-9e93-910ddfc0d482 tempest-VolumeImageDependencyTests-1874823607 None] Lock "cinder-e9818853-ea86-4e85-87fc-46e1f5bbb95a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:02 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c44f0ad8-6a21-41de-9e93-910ddfc0d482 tempest-VolumeImageDependencyTests-1874823607 None] Acquiring lock "cinder-quobyte-e9818853-ea86-4e85-87fc-46e1f5bbb95a" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:02 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c44f0ad8-6a21-41de-9e93-910ddfc0d482 tempest-VolumeImageDependencyTests-1874823607 None] Lock "cinder-quobyte-e9818853-ea86-4e85-87fc-46e1f5bbb95a" acquired by "delete_volume" :: waited 0.013s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:02 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[550f505b-11ab-4b15-b8d1-d4a8c659258c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:45:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c44f0ad8-6a21-41de-9e93-910ddfc0d482 tempest-VolumeImageDependencyTests-1874823607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9818853-ea86-4e85-87fc-46e1f5bbb95a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:02 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9818853-ea86-4e85-87fc-46e1f5bbb95a Nov 06 14:45:02 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:02 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c44f0ad8-6a21-41de-9e93-910ddfc0d482 tempest-VolumeImageDependencyTests-1874823607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9818853-ea86-4e85-87fc-46e1f5bbb95a" returned: 0 in 0.350s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c44f0ad8-6a21-41de-9e93-910ddfc0d482 tempest-VolumeImageDependencyTests-1874823607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9818853-ea86-4e85-87fc-46e1f5bbb95a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:02 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9818853-ea86-4e85-87fc-46e1f5bbb95a Nov 06 14:45:02 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:03 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c44f0ad8-6a21-41de-9e93-910ddfc0d482 tempest-VolumeImageDependencyTests-1874823607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e9818853-ea86-4e85-87fc-46e1f5bbb95a" returned: 0 in 0.240s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:03 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c44f0ad8-6a21-41de-9e93-910ddfc0d482 tempest-VolumeImageDependencyTests-1874823607 None] Lock "cinder-quobyte-e9818853-ea86-4e85-87fc-46e1f5bbb95a" released by "delete_volume" :: held 0.631s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:03 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-c44f0ad8-6a21-41de-9e93-910ddfc0d482 tempest-VolumeImageDependencyTests-1874823607 None] Created reservations ['ef53617c-7b3f-4d82-a0ce-df1af1485fda', '19d3d23f-cab5-4f8f-89fe-2e9fe47a1d8d', '2ec76b51-f3ca-4693-82ea-2e4424c24b45', '9e9eeb55-9fdc-4b98-ad41-c4613bdee8c4'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:45:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c44f0ad8-6a21-41de-9e93-910ddfc0d482 tempest-VolumeImageDependencyTests-1874823607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c44f0ad8-6a21-41de-9e93-910ddfc0d482 tempest-VolumeImageDependencyTests-1874823607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:03 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c44f0ad8-6a21-41de-9e93-910ddfc0d482 tempest-VolumeImageDependencyTests-1874823607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:03 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c44f0ad8-6a21-41de-9e93-910ddfc0d482 tempest-VolumeImageDependencyTests-1874823607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c44f0ad8-6a21-41de-9e93-910ddfc0d482 tempest-VolumeImageDependencyTests-1874823607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c44f0ad8-6a21-41de-9e93-910ddfc0d482 tempest-VolumeImageDependencyTests-1874823607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:03 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:45:03 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:03 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c44f0ad8-6a21-41de-9e93-910ddfc0d482 tempest-VolumeImageDependencyTests-1874823607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.245s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:03 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-c44f0ad8-6a21-41de-9e93-910ddfc0d482 tempest-VolumeImageDependencyTests-1874823607 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:45:03 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-c44f0ad8-6a21-41de-9e93-910ddfc0d482 tempest-VolumeImageDependencyTests-1874823607 None] Deleted volume successfully. Nov 06 14:45:03 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c44f0ad8-6a21-41de-9e93-910ddfc0d482 tempest-VolumeImageDependencyTests-1874823607 None] Lock "cinder-e9818853-ea86-4e85-87fc-46e1f5bbb95a-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Flow 'volume_create_manager' (b98cf268-cc33-4dc4-bdaf-c296faf81d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e8c7ab-e80b-4cb8-89d1-e3259c66b99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e8c7ab-e80b-4cb8-89d1-e3259c66b99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-772351092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1c024c-900c-449b-acdc-28c5a4d45ce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a4979a671e472385daf968365d04dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:11Z,use_quota=True,user_id='a6fd0ccdc43c4508ab917773d324b4b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5853e26-714b-4231-8c83-98af820584b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5853e26-714b-4231-8c83-98af820584b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c8b0d3-f5a4-409d-aa22-9d747576a993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c8b0d3-f5a4-409d-aa22-9d747576a993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab1c024c-900c-449b-acdc-28c5a4d45ce2', 'volume_name': 'volume-ab1c024c-900c-449b-acdc-28c5a4d45ce2', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6084b02-873e-4845-b778-4a713fe8f901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6084b02-873e-4845-b778-4a713fe8f901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b911603-a7c5-4501-975c-2e9c067ec10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:11 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Volume ab1c024c-900c-449b-acdc-28c5a4d45ce2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab1c024c-900c-449b-acdc-28c5a4d45ce2', 'volume_size': 1} Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-772351092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1c024c-900c-449b-acdc-28c5a4d45ce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a4979a671e472385daf968365d04dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:11Z,use_quota=True,user_id='a6fd0ccdc43c4508ab917773d324b4b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Creating volume ab1c024c-900c-449b-acdc-28c5a4d45ce2 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:45:11 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ab1c024c-900c-449b-acdc-28c5a4d45ce2 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:11 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ab1c024c-900c-449b-acdc-28c5a4d45ce2 1073741824 Nov 06 14:45:11 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:11 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ab1c024c-900c-449b-acdc-28c5a4d45ce2 1073741824" returned: 0 in 0.394s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ab1c024c-900c-449b-acdc-28c5a4d45ce2 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:11 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ab1c024c-900c-449b-acdc-28c5a4d45ce2 Nov 06 14:45:11 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:11 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ab1c024c-900c-449b-acdc-28c5a4d45ce2" returned: 0 in 0.238s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b911603-a7c5-4501-975c-2e9c067ec10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab1c024c-900c-449b-acdc-28c5a4d45ce2', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9222c7c-1855-4eed-bc50-178169212f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:11 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Volume volume-ab1c024c-900c-449b-acdc-28c5a4d45ce2 (ab1c024c-900c-449b-acdc-28c5a4d45ce2): created successfully Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9222c7c-1855-4eed-bc50-178169212f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:11 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Flow 'volume_create_manager' (b98cf268-cc33-4dc4-bdaf-c296faf81d05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:11 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-22b8b03c-81d9-48e0-915e-2236bea731eb tempest-ProjectReaderTests-340476998 None] Created volume successfully. Nov 06 14:45:12 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-66491ece-7d2c-452f-9797-921537b53ecb tempest-ProjectReaderTests-340476998 None] Acquiring lock "cinder-ab1c024c-900c-449b-acdc-28c5a4d45ce2-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:12 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-66491ece-7d2c-452f-9797-921537b53ecb tempest-ProjectReaderTests-340476998 None] Lock "cinder-ab1c024c-900c-449b-acdc-28c5a4d45ce2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:12 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-66491ece-7d2c-452f-9797-921537b53ecb tempest-ProjectReaderTests-340476998 None] Acquiring lock "cinder-quobyte-ab1c024c-900c-449b-acdc-28c5a4d45ce2" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:12 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-66491ece-7d2c-452f-9797-921537b53ecb tempest-ProjectReaderTests-340476998 None] Lock "cinder-quobyte-ab1c024c-900c-449b-acdc-28c5a4d45ce2" acquired by "delete_volume" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:12 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a002d3c-1e3b-4ad0-88e8-133580f3336a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:45:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-66491ece-7d2c-452f-9797-921537b53ecb tempest-ProjectReaderTests-340476998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ab1c024c-900c-449b-acdc-28c5a4d45ce2 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:12 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ab1c024c-900c-449b-acdc-28c5a4d45ce2 Nov 06 14:45:12 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:12 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-66491ece-7d2c-452f-9797-921537b53ecb tempest-ProjectReaderTests-340476998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ab1c024c-900c-449b-acdc-28c5a4d45ce2" returned: 0 in 0.362s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-66491ece-7d2c-452f-9797-921537b53ecb tempest-ProjectReaderTests-340476998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ab1c024c-900c-449b-acdc-28c5a4d45ce2 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:12 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ab1c024c-900c-449b-acdc-28c5a4d45ce2 Nov 06 14:45:12 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:12 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-66491ece-7d2c-452f-9797-921537b53ecb tempest-ProjectReaderTests-340476998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-ab1c024c-900c-449b-acdc-28c5a4d45ce2" returned: 0 in 0.247s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:12 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-66491ece-7d2c-452f-9797-921537b53ecb tempest-ProjectReaderTests-340476998 None] Lock "cinder-quobyte-ab1c024c-900c-449b-acdc-28c5a4d45ce2" released by "delete_volume" :: held 0.649s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:12 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-66491ece-7d2c-452f-9797-921537b53ecb tempest-ProjectReaderTests-340476998 None] Created reservations ['98b9b200-08ab-4385-afdd-34612757bd3a', 'b5f46807-fddb-4936-b968-c18bcfa4ce0c', '007f6b90-2851-498f-a33f-8c4ba9142de8', 'a317391b-57f0-49ff-82a0-72cd74e1b60b'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:45:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-66491ece-7d2c-452f-9797-921537b53ecb tempest-ProjectReaderTests-340476998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-66491ece-7d2c-452f-9797-921537b53ecb tempest-ProjectReaderTests-340476998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:13 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-66491ece-7d2c-452f-9797-921537b53ecb tempest-ProjectReaderTests-340476998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:13 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-66491ece-7d2c-452f-9797-921537b53ecb tempest-ProjectReaderTests-340476998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-66491ece-7d2c-452f-9797-921537b53ecb tempest-ProjectReaderTests-340476998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-66491ece-7d2c-452f-9797-921537b53ecb tempest-ProjectReaderTests-340476998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:13 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:45:13 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:13 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-66491ece-7d2c-452f-9797-921537b53ecb tempest-ProjectReaderTests-340476998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.238s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:13 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-66491ece-7d2c-452f-9797-921537b53ecb tempest-ProjectReaderTests-340476998 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:45:13 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-66491ece-7d2c-452f-9797-921537b53ecb tempest-ProjectReaderTests-340476998 None] Deleted volume successfully. Nov 06 14:45:13 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-66491ece-7d2c-452f-9797-921537b53ecb tempest-ProjectReaderTests-340476998 None] Lock "cinder-ab1c024c-900c-449b-acdc-28c5a4d45ce2-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Flow 'volume_create_manager' (5f3bcbf6-a22e-41a4-8c92-261400b4bb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74b720b-d77e-4e7f-bcff-4a3d4fc9ec25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74b720b-d77e-4e7f-bcff-4a3d4fc9ec25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2043882830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d199252-83c4-446e-aa51-9949f20b46e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a4979a671e472385daf968365d04dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:14Z,use_quota=True,user_id='a6fd0ccdc43c4508ab917773d324b4b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a919f080-aaa2-4889-83a1-67928b08bcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a919f080-aaa2-4889-83a1-67928b08bcd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6f7fba-e5a0-4451-bdb5-4e7b00cea06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6f7fba-e5a0-4451-bdb5-4e7b00cea06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d199252-83c4-446e-aa51-9949f20b46e2', 'volume_name': 'volume-8d199252-83c4-446e-aa51-9949f20b46e2', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b86cdfe-7fcd-497c-b87c-f1de08afdb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b86cdfe-7fcd-497c-b87c-f1de08afdb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce1b0eaf-650f-49cc-8aad-cef692963acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:14 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Volume 8d199252-83c4-446e-aa51-9949f20b46e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d199252-83c4-446e-aa51-9949f20b46e2', 'volume_size': 1} Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2043882830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d199252-83c4-446e-aa51-9949f20b46e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a4979a671e472385daf968365d04dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:14Z,use_quota=True,user_id='a6fd0ccdc43c4508ab917773d324b4b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Creating volume 8d199252-83c4-446e-aa51-9949f20b46e2 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:45:14 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d199252-83c4-446e-aa51-9949f20b46e2 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:14 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d199252-83c4-446e-aa51-9949f20b46e2 1073741824 Nov 06 14:45:14 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:14 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d199252-83c4-446e-aa51-9949f20b46e2 1073741824" returned: 0 in 0.405s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d199252-83c4-446e-aa51-9949f20b46e2 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:14 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d199252-83c4-446e-aa51-9949f20b46e2 Nov 06 14:45:14 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:14 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d199252-83c4-446e-aa51-9949f20b46e2" returned: 0 in 0.239s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce1b0eaf-650f-49cc-8aad-cef692963acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d199252-83c4-446e-aa51-9949f20b46e2', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd10c64c-ba1b-47df-824a-303b23867dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:14 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Volume volume-8d199252-83c4-446e-aa51-9949f20b46e2 (8d199252-83c4-446e-aa51-9949f20b46e2): created successfully Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd10c64c-ba1b-47df-824a-303b23867dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Flow 'volume_create_manager' (5f3bcbf6-a22e-41a4-8c92-261400b4bb94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:14 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-1887f979-8056-4f98-9a0d-6cd24dc69f38 tempest-ProjectReaderTests-340476998 None] Created volume successfully. Nov 06 14:45:15 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e76de05a-98b5-4946-88d8-45fc45bece8a tempest-ProjectReaderTests-340476998 None] Acquiring lock "cinder-8d199252-83c4-446e-aa51-9949f20b46e2-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:15 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e76de05a-98b5-4946-88d8-45fc45bece8a tempest-ProjectReaderTests-340476998 None] Lock "cinder-8d199252-83c4-446e-aa51-9949f20b46e2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:15 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e76de05a-98b5-4946-88d8-45fc45bece8a tempest-ProjectReaderTests-340476998 None] Acquiring lock "cinder-quobyte-8d199252-83c4-446e-aa51-9949f20b46e2" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:15 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e76de05a-98b5-4946-88d8-45fc45bece8a tempest-ProjectReaderTests-340476998 None] Lock "cinder-quobyte-8d199252-83c4-446e-aa51-9949f20b46e2" acquired by "delete_volume" :: waited 0.014s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:15 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[da66eff6-4693-4fbd-8170-e270c3b1ce15]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:45:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e76de05a-98b5-4946-88d8-45fc45bece8a tempest-ProjectReaderTests-340476998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d199252-83c4-446e-aa51-9949f20b46e2 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:15 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d199252-83c4-446e-aa51-9949f20b46e2 Nov 06 14:45:15 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:15 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e76de05a-98b5-4946-88d8-45fc45bece8a tempest-ProjectReaderTests-340476998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d199252-83c4-446e-aa51-9949f20b46e2" returned: 0 in 0.349s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e76de05a-98b5-4946-88d8-45fc45bece8a tempest-ProjectReaderTests-340476998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d199252-83c4-446e-aa51-9949f20b46e2 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:15 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d199252-83c4-446e-aa51-9949f20b46e2 Nov 06 14:45:15 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:15 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e76de05a-98b5-4946-88d8-45fc45bece8a tempest-ProjectReaderTests-340476998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8d199252-83c4-446e-aa51-9949f20b46e2" returned: 0 in 0.242s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:15 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e76de05a-98b5-4946-88d8-45fc45bece8a tempest-ProjectReaderTests-340476998 None] Lock "cinder-quobyte-8d199252-83c4-446e-aa51-9949f20b46e2" released by "delete_volume" :: held 0.631s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:15 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-e76de05a-98b5-4946-88d8-45fc45bece8a tempest-ProjectReaderTests-340476998 None] Created reservations ['0ecb3194-84d1-470d-a0fc-44bebccc335a', 'b5e28378-02ea-4ab5-8c91-ce6554949170', '8f3f2829-327d-4fc4-8dad-bfb855f499c1', '165a6829-4a5b-4967-b5bf-23590ac0ecea'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:45:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e76de05a-98b5-4946-88d8-45fc45bece8a tempest-ProjectReaderTests-340476998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e76de05a-98b5-4946-88d8-45fc45bece8a tempest-ProjectReaderTests-340476998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e76de05a-98b5-4946-88d8-45fc45bece8a tempest-ProjectReaderTests-340476998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e76de05a-98b5-4946-88d8-45fc45bece8a tempest-ProjectReaderTests-340476998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e76de05a-98b5-4946-88d8-45fc45bece8a tempest-ProjectReaderTests-340476998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e76de05a-98b5-4946-88d8-45fc45bece8a tempest-ProjectReaderTests-340476998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:15 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:45:15 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:16 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e76de05a-98b5-4946-88d8-45fc45bece8a tempest-ProjectReaderTests-340476998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.238s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:16 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-e76de05a-98b5-4946-88d8-45fc45bece8a tempest-ProjectReaderTests-340476998 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:45:16 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-e76de05a-98b5-4946-88d8-45fc45bece8a tempest-ProjectReaderTests-340476998 None] Deleted volume successfully. Nov 06 14:45:16 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e76de05a-98b5-4946-88d8-45fc45bece8a tempest-ProjectReaderTests-340476998 None] Lock "cinder-8d199252-83c4-446e-aa51-9949f20b46e2-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:16 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:45:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Flow 'volume_create_manager' (c2c2741d-3f05-41ba-97c0-4e1e5e050b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9654f460-ae62-4830-a932-b014a32064cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9654f460-ae62-4830-a932-b014a32064cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1630208055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1388772-683d-4ae2-afea-6da17082c8b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a4979a671e472385daf968365d04dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:17Z,use_quota=True,user_id='a6fd0ccdc43c4508ab917773d324b4b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b3c9f8-acb4-451c-b97e-389a0974b4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b3c9f8-acb4-451c-b97e-389a0974b4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c567edd-2e98-4813-9237-20b81c0f08e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c567edd-2e98-4813-9237-20b81c0f08e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1388772-683d-4ae2-afea-6da17082c8b0', 'volume_name': 'volume-c1388772-683d-4ae2-afea-6da17082c8b0', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b3df5c2-8224-4ac0-ada6-d41c4569551e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b3df5c2-8224-4ac0-ada6-d41c4569551e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f819aa12-fa0d-4948-82cb-83ccaa0b8f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:16 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Volume c1388772-683d-4ae2-afea-6da17082c8b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1388772-683d-4ae2-afea-6da17082c8b0', 'volume_size': 1} Nov 06 14:45:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1630208055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1388772-683d-4ae2-afea-6da17082c8b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a4979a671e472385daf968365d04dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:17Z,use_quota=True,user_id='a6fd0ccdc43c4508ab917773d324b4b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:45:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Creating volume c1388772-683d-4ae2-afea-6da17082c8b0 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:45:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:45:16 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:45:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c1388772-683d-4ae2-afea-6da17082c8b0 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:16 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c1388772-683d-4ae2-afea-6da17082c8b0 1073741824 Nov 06 14:45:16 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:17 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c1388772-683d-4ae2-afea-6da17082c8b0 1073741824" returned: 0 in 0.410s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c1388772-683d-4ae2-afea-6da17082c8b0 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:17 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c1388772-683d-4ae2-afea-6da17082c8b0 Nov 06 14:45:17 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:17 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c1388772-683d-4ae2-afea-6da17082c8b0" returned: 0 in 0.238s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:45:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f819aa12-fa0d-4948-82cb-83ccaa0b8f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1388772-683d-4ae2-afea-6da17082c8b0', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f3ae00f-0526-4954-8abf-1fab03b7a9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:17 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Volume volume-c1388772-683d-4ae2-afea-6da17082c8b0 (c1388772-683d-4ae2-afea-6da17082c8b0): created successfully Nov 06 14:45:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f3ae00f-0526-4954-8abf-1fab03b7a9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Flow 'volume_create_manager' (c2c2741d-3f05-41ba-97c0-4e1e5e050b11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:17 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-ea090c3c-6e49-4059-93dd-8e90cd02b53c tempest-ProjectReaderTests-340476998 None] Created volume successfully. Nov 06 14:45:17 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-65420f0c-b461-45f3-af7e-4d5f5c45814c tempest-ProjectReaderTests-340476998 None] Acquiring lock "cinder-c1388772-683d-4ae2-afea-6da17082c8b0-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:17 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-65420f0c-b461-45f3-af7e-4d5f5c45814c tempest-ProjectReaderTests-340476998 None] Lock "cinder-c1388772-683d-4ae2-afea-6da17082c8b0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:17 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-65420f0c-b461-45f3-af7e-4d5f5c45814c tempest-ProjectReaderTests-340476998 None] Acquiring lock "cinder-quobyte-c1388772-683d-4ae2-afea-6da17082c8b0" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:17 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-65420f0c-b461-45f3-af7e-4d5f5c45814c tempest-ProjectReaderTests-340476998 None] Lock "cinder-quobyte-c1388772-683d-4ae2-afea-6da17082c8b0" acquired by "delete_volume" :: waited 0.014s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:17 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9666ef-3a66-44e5-8ac0-46be86f0ccb8]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:45:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-65420f0c-b461-45f3-af7e-4d5f5c45814c tempest-ProjectReaderTests-340476998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c1388772-683d-4ae2-afea-6da17082c8b0 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:17 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c1388772-683d-4ae2-afea-6da17082c8b0 Nov 06 14:45:17 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:18 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-65420f0c-b461-45f3-af7e-4d5f5c45814c tempest-ProjectReaderTests-340476998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c1388772-683d-4ae2-afea-6da17082c8b0" returned: 0 in 0.347s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-65420f0c-b461-45f3-af7e-4d5f5c45814c tempest-ProjectReaderTests-340476998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c1388772-683d-4ae2-afea-6da17082c8b0 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:18 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c1388772-683d-4ae2-afea-6da17082c8b0 Nov 06 14:45:18 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:18 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-65420f0c-b461-45f3-af7e-4d5f5c45814c tempest-ProjectReaderTests-340476998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c1388772-683d-4ae2-afea-6da17082c8b0" returned: 0 in 0.235s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-65420f0c-b461-45f3-af7e-4d5f5c45814c tempest-ProjectReaderTests-340476998 None] Lock "cinder-quobyte-c1388772-683d-4ae2-afea-6da17082c8b0" released by "delete_volume" :: held 0.625s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:18 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-65420f0c-b461-45f3-af7e-4d5f5c45814c tempest-ProjectReaderTests-340476998 None] Created reservations ['67d00af9-0a7b-48d6-8bca-b68f211f0592', '19466b53-227b-460d-951d-f2572bf8e3eb', '316a68c4-5923-4bd6-a24a-e35c91ff206b', 'eeaaa9a5-10ca-48f1-8663-4aaab9837595'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:45:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-65420f0c-b461-45f3-af7e-4d5f5c45814c tempest-ProjectReaderTests-340476998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-65420f0c-b461-45f3-af7e-4d5f5c45814c tempest-ProjectReaderTests-340476998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:18 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-65420f0c-b461-45f3-af7e-4d5f5c45814c tempest-ProjectReaderTests-340476998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:18 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-65420f0c-b461-45f3-af7e-4d5f5c45814c tempest-ProjectReaderTests-340476998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-65420f0c-b461-45f3-af7e-4d5f5c45814c tempest-ProjectReaderTests-340476998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-65420f0c-b461-45f3-af7e-4d5f5c45814c tempest-ProjectReaderTests-340476998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:18 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:45:18 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:18 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-65420f0c-b461-45f3-af7e-4d5f5c45814c tempest-ProjectReaderTests-340476998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.239s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:18 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-65420f0c-b461-45f3-af7e-4d5f5c45814c tempest-ProjectReaderTests-340476998 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:45:18 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-65420f0c-b461-45f3-af7e-4d5f5c45814c tempest-ProjectReaderTests-340476998 None] Deleted volume successfully. Nov 06 14:45:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-65420f0c-b461-45f3-af7e-4d5f5c45814c tempest-ProjectReaderTests-340476998 None] Lock "cinder-c1388772-683d-4ae2-afea-6da17082c8b0-delete_volume" released by "delete_volume" :: held 1.040s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:19 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:45:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Flow 'volume_create_manager' (3ce96ba5-93bf-40f5-9df4-6b90674505b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e32dced7-5ff8-4864-ac7e-879fb479b665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e32dced7-5ff8-4864-ac7e-879fb479b665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1000093945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e609c0-566b-4209-b3d3-0ed6374b90b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a4979a671e472385daf968365d04dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:19Z,use_quota=True,user_id='a6fd0ccdc43c4508ab917773d324b4b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cde7ca5-5ba9-44f6-9f34-a3a34c98bb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cde7ca5-5ba9-44f6-9f34-a3a34c98bb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03eee72-c8d9-47a1-b7fb-5493b128184a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03eee72-c8d9-47a1-b7fb-5493b128184a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56e609c0-566b-4209-b3d3-0ed6374b90b9', 'volume_name': 'volume-56e609c0-566b-4209-b3d3-0ed6374b90b9', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3db31f-6316-4119-b8d0-27bcba5ed140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3db31f-6316-4119-b8d0-27bcba5ed140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fe95a37-0bc4-4165-8dc4-ff139473e852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:19 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Volume 56e609c0-566b-4209-b3d3-0ed6374b90b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56e609c0-566b-4209-b3d3-0ed6374b90b9', 'volume_size': 1} Nov 06 14:45:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1000093945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e609c0-566b-4209-b3d3-0ed6374b90b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a4979a671e472385daf968365d04dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:19Z,use_quota=True,user_id='a6fd0ccdc43c4508ab917773d324b4b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:45:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Creating volume 56e609c0-566b-4209-b3d3-0ed6374b90b9 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:45:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:45:19 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:45:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56e609c0-566b-4209-b3d3-0ed6374b90b9 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:19 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56e609c0-566b-4209-b3d3-0ed6374b90b9 1073741824 Nov 06 14:45:19 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:19 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56e609c0-566b-4209-b3d3-0ed6374b90b9 1073741824" returned: 0 in 0.414s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56e609c0-566b-4209-b3d3-0ed6374b90b9 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:19 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56e609c0-566b-4209-b3d3-0ed6374b90b9 Nov 06 14:45:19 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:20 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56e609c0-566b-4209-b3d3-0ed6374b90b9" returned: 0 in 0.246s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:45:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fe95a37-0bc4-4165-8dc4-ff139473e852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56e609c0-566b-4209-b3d3-0ed6374b90b9', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad0948d1-544f-4a69-9c36-8ce093140e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:20 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Volume volume-56e609c0-566b-4209-b3d3-0ed6374b90b9 (56e609c0-566b-4209-b3d3-0ed6374b90b9): created successfully Nov 06 14:45:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad0948d1-544f-4a69-9c36-8ce093140e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Flow 'volume_create_manager' (3ce96ba5-93bf-40f5-9df4-6b90674505b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:20 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-cee159f7-e193-454e-9cc1-ba20bc56cbe8 tempest-ProjectReaderTests-340476998 None] Created volume successfully. Nov 06 14:45:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-dc8ed498-9775-4877-ac12-70fd6e05f758 tempest-ProjectReaderTests-340476998 None] Acquiring lock "cinder-56e609c0-566b-4209-b3d3-0ed6374b90b9-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-dc8ed498-9775-4877-ac12-70fd6e05f758 tempest-ProjectReaderTests-340476998 None] Lock "cinder-56e609c0-566b-4209-b3d3-0ed6374b90b9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-dc8ed498-9775-4877-ac12-70fd6e05f758 tempest-ProjectReaderTests-340476998 None] Acquiring lock "cinder-quobyte-56e609c0-566b-4209-b3d3-0ed6374b90b9" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-dc8ed498-9775-4877-ac12-70fd6e05f758 tempest-ProjectReaderTests-340476998 None] Lock "cinder-quobyte-56e609c0-566b-4209-b3d3-0ed6374b90b9" acquired by "delete_volume" :: waited 0.016s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:20 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c188a5f-7c57-4676-b051-1268fee6cd9b]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:45:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-dc8ed498-9775-4877-ac12-70fd6e05f758 tempest-ProjectReaderTests-340476998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56e609c0-566b-4209-b3d3-0ed6374b90b9 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:20 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56e609c0-566b-4209-b3d3-0ed6374b90b9 Nov 06 14:45:20 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:20 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-dc8ed498-9775-4877-ac12-70fd6e05f758 tempest-ProjectReaderTests-340476998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56e609c0-566b-4209-b3d3-0ed6374b90b9" returned: 0 in 0.368s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-dc8ed498-9775-4877-ac12-70fd6e05f758 tempest-ProjectReaderTests-340476998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56e609c0-566b-4209-b3d3-0ed6374b90b9 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:20 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56e609c0-566b-4209-b3d3-0ed6374b90b9 Nov 06 14:45:20 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:21 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-dc8ed498-9775-4877-ac12-70fd6e05f758 tempest-ProjectReaderTests-340476998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-56e609c0-566b-4209-b3d3-0ed6374b90b9" returned: 0 in 0.245s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-dc8ed498-9775-4877-ac12-70fd6e05f758 tempest-ProjectReaderTests-340476998 None] Lock "cinder-quobyte-56e609c0-566b-4209-b3d3-0ed6374b90b9" released by "delete_volume" :: held 0.658s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:21 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-dc8ed498-9775-4877-ac12-70fd6e05f758 tempest-ProjectReaderTests-340476998 None] Created reservations ['e842545c-1da0-4087-afad-e44e4650ac22', 'aaa67be5-0b37-409c-931b-62727b1f4fca', '23deade8-b26e-4cfb-b921-fb0b5287ee39', '0bac2cf3-eeca-4aa7-92e0-e3bdf6c4ac76'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:45:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-dc8ed498-9775-4877-ac12-70fd6e05f758 tempest-ProjectReaderTests-340476998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-dc8ed498-9775-4877-ac12-70fd6e05f758 tempest-ProjectReaderTests-340476998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-dc8ed498-9775-4877-ac12-70fd6e05f758 tempest-ProjectReaderTests-340476998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-dc8ed498-9775-4877-ac12-70fd6e05f758 tempest-ProjectReaderTests-340476998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-dc8ed498-9775-4877-ac12-70fd6e05f758 tempest-ProjectReaderTests-340476998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-dc8ed498-9775-4877-ac12-70fd6e05f758 tempest-ProjectReaderTests-340476998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:21 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:45:21 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:21 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-dc8ed498-9775-4877-ac12-70fd6e05f758 tempest-ProjectReaderTests-340476998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.238s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:21 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-dc8ed498-9775-4877-ac12-70fd6e05f758 tempest-ProjectReaderTests-340476998 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:45:21 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-dc8ed498-9775-4877-ac12-70fd6e05f758 tempest-ProjectReaderTests-340476998 None] Deleted volume successfully. Nov 06 14:45:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-dc8ed498-9775-4877-ac12-70fd6e05f758 tempest-ProjectReaderTests-340476998 None] Lock "cinder-56e609c0-566b-4209-b3d3-0ed6374b90b9-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager._thread_info {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:45:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread count: 28 {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 14:45:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread info: [<_MainThread(MainThread, started 130306900594816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 14:45:31 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=38,cinder:UPDATE=54,cinder:INSERT=18,cinder:DELETE=7 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:45:31 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=44,cinder:INSERT=16,cinder:UPDATE=60,cinder:DELETE=3 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:45:33 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:45:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Flow 'volume_create_manager' (35927d82-930c-4af0-8fa1-129fa3a7988b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9be93829-99f9-4413-8a64-28c4c638e09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9be93829-99f9-4413-8a64-28c4c638e09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0bcb894-11e2-4a9a-8b87-5756f5a86ffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16bf6dd9019944409f7877376f0d7e53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:34Z,use_quota=True,user_id='6a74976d05c04ab5b206aab558ca0d91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (846457b4-2636-4040-9e0e-b68abc37080c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (846457b4-2636-4040-9e0e-b68abc37080c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8427d8ed-dee3-4b14-93a6-d32eed410c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8427d8ed-dee3-4b14-93a6-d32eed410c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0bcb894-11e2-4a9a-8b87-5756f5a86ffe', 'volume_name': 'volume-f0bcb894-11e2-4a9a-8b87-5756f5a86ffe', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9606083-be8f-4d3f-9567-f31a5ed52741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9606083-be8f-4d3f-9567-f31a5ed52741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3150533e-ff91-402d-9f0f-1c408527c4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:33 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Volume f0bcb894-11e2-4a9a-8b87-5756f5a86ffe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0bcb894-11e2-4a9a-8b87-5756f5a86ffe', 'volume_size': 1} Nov 06 14:45:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0bcb894-11e2-4a9a-8b87-5756f5a86ffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16bf6dd9019944409f7877376f0d7e53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:34Z,use_quota=True,user_id='6a74976d05c04ab5b206aab558ca0d91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:45:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Creating volume f0bcb894-11e2-4a9a-8b87-5756f5a86ffe {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:45:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:45:33 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:45:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f0bcb894-11e2-4a9a-8b87-5756f5a86ffe 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:33 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f0bcb894-11e2-4a9a-8b87-5756f5a86ffe 1073741824 Nov 06 14:45:33 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:33 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:45:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Flow 'volume_create_manager' (fef8abfe-57cc-4d01-a50c-21fc897b3321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf7bb6d-721c-4921-adb5-8b4d08900730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf7bb6d-721c-4921-adb5-8b4d08900730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1160252276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62cf871-7e0f-4712-bbfd-a03ed4ca54e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ed6c6986644e789e3c364c2772af5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:34Z,use_quota=True,user_id='a2abb1d0830d45c5977814446db56b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88bf43aa-f1b9-4f92-8bed-77e3c4d52928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88bf43aa-f1b9-4f92-8bed-77e3c4d52928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e38468e3-5a8a-499e-a7da-a3d35c3d036c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e38468e3-5a8a-499e-a7da-a3d35c3d036c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c62cf871-7e0f-4712-bbfd-a03ed4ca54e2', 'volume_name': 'volume-c62cf871-7e0f-4712-bbfd-a03ed4ca54e2', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992e09a2-4f37-4cfd-a414-65ff227de30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992e09a2-4f37-4cfd-a414-65ff227de30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ddec82-d9df-4bcf-baeb-8ad5bf95fee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:34 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Volume c62cf871-7e0f-4712-bbfd-a03ed4ca54e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c62cf871-7e0f-4712-bbfd-a03ed4ca54e2', 'volume_size': 1} Nov 06 14:45:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:34 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:45:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Flow 'volume_create_manager' (d902b0a1-2e9c-46d0-bbaf-f3dab2e56f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab1c64e7-bbba-4b49-929b-95416180bad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab1c64e7-bbba-4b49-929b-95416180bad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1977506926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aef2d719-b0a9-498a-a34f-93ddb54f9ac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ed6c6986644e789e3c364c2772af5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:34Z,use_quota=True,user_id='a2abb1d0830d45c5977814446db56b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (381f0482-58fc-4f38-9efb-13d89c95e359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (381f0482-58fc-4f38-9efb-13d89c95e359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c49f61c7-47ad-4167-b4b6-08d15889364a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c49f61c7-47ad-4167-b4b6-08d15889364a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aef2d719-b0a9-498a-a34f-93ddb54f9ac2', 'volume_name': 'volume-aef2d719-b0a9-498a-a34f-93ddb54f9ac2', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab937522-150e-442e-b55a-b51ed45792ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab937522-150e-442e-b55a-b51ed45792ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72f558f-ccc4-4a11-96e0-c4fcc064d83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:34 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Volume aef2d719-b0a9-498a-a34f-93ddb54f9ac2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aef2d719-b0a9-498a-a34f-93ddb54f9ac2', 'volume_size': 1} Nov 06 14:45:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:34 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f0bcb894-11e2-4a9a-8b87-5756f5a86ffe 1073741824" returned: 0 in 0.758s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f0bcb894-11e2-4a9a-8b87-5756f5a86ffe {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:34 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f0bcb894-11e2-4a9a-8b87-5756f5a86ffe Nov 06 14:45:34 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:34 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:45:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Flow 'volume_create_manager' (596dbf6b-5dcc-4f4f-a933-01760e75a84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54881574-73e3-45ca-ba4b-32a1ec4840d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54881574-73e3-45ca-ba4b-32a1ec4840d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-72125044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53cb28a-6b98-4403-895a-61d1bae8c650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ed6c6986644e789e3c364c2772af5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:35Z,use_quota=True,user_id='a2abb1d0830d45c5977814446db56b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad41c730-45ca-4ad3-8d62-adaa6c8ad9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad41c730-45ca-4ad3-8d62-adaa6c8ad9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e14e5d-5fb9-4793-a5ff-3fdd639a540c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:35 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e14e5d-5fb9-4793-a5ff-3fdd639a540c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e53cb28a-6b98-4403-895a-61d1bae8c650', 'volume_name': 'volume-e53cb28a-6b98-4403-895a-61d1bae8c650', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d3f379-df51-4dad-bdd3-cfcf328a95bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d3f379-df51-4dad-bdd3-cfcf328a95bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb4063f-7500-4837-b8ae-3e85b33f55b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:35 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Volume e53cb28a-6b98-4403-895a-61d1bae8c650: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e53cb28a-6b98-4403-895a-61d1bae8c650', 'volume_size': 1} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f0bcb894-11e2-4a9a-8b87-5756f5a86ffe" returned: 0 in 0.475s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] <== create_volume: return (1304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.953s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1160252276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62cf871-7e0f-4712-bbfd-a03ed4ca54e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ed6c6986644e789e3c364c2772af5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:34Z,use_quota=True,user_id='a2abb1d0830d45c5977814446db56b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Creating volume c62cf871-7e0f-4712-bbfd-a03ed4ca54e2 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:45:35 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c62cf871-7e0f-4712-bbfd-a03ed4ca54e2 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:35 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c62cf871-7e0f-4712-bbfd-a03ed4ca54e2 1073741824 Nov 06 14:45:35 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3150533e-ff91-402d-9f0f-1c408527c4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0bcb894-11e2-4a9a-8b87-5756f5a86ffe', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b562dcab-00b0-4668-91e2-fded3271f01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:35 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Volume volume-f0bcb894-11e2-4a9a-8b87-5756f5a86ffe (f0bcb894-11e2-4a9a-8b87-5756f5a86ffe): created successfully Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b562dcab-00b0-4668-91e2-fded3271f01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Flow 'volume_create_manager' (35927d82-930c-4af0-8fa1-129fa3a7988b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:35 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-c05adaad-8861-4439-a2f6-378df194c11c tempest-CinderUnicodeTest-1342569683 None] Created volume successfully. Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Flow 'volume_create_manager' (9aa84cb5-2bce-4930-a3b7-d67258ba1e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bfa1d59-e850-4d0d-b9d8-d383e3940024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bfa1d59-e850-4d0d-b9d8-d383e3940024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1711543937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c22ff543-6c48-4d19-a829-c1bbab6c3038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ed6c6986644e789e3c364c2772af5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:35Z,use_quota=True,user_id='a2abb1d0830d45c5977814446db56b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e49dfd00-bf75-470a-8a3b-f09d1a50e3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e49dfd00-bf75-470a-8a3b-f09d1a50e3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (301f20f2-adb5-4715-9759-3ba9651f4706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (301f20f2-adb5-4715-9759-3ba9651f4706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c22ff543-6c48-4d19-a829-c1bbab6c3038', 'volume_name': 'volume-c22ff543-6c48-4d19-a829-c1bbab6c3038', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a041914a-fe75-465c-a3d4-5585b130048c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a041914a-fe75-465c-a3d4-5585b130048c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d21c5a-efbe-4d23-b5d4-7a5e0038fe0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:35 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Volume c22ff543-6c48-4d19-a829-c1bbab6c3038: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c22ff543-6c48-4d19-a829-c1bbab6c3038', 'volume_size': 1} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:35 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c62cf871-7e0f-4712-bbfd-a03ed4ca54e2 1073741824" returned: 0 in 0.576s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c62cf871-7e0f-4712-bbfd-a03ed4ca54e2 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:35 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c62cf871-7e0f-4712-bbfd-a03ed4ca54e2 Nov 06 14:45:35 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Flow 'volume_create_manager' (a950eee3-3b98-4f76-aeb9-b13a2ed113df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c00284-2241-49c7-9498-ac2b5d9c814a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c00284-2241-49c7-9498-ac2b5d9c814a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-569739237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6617671d-8eb0-4d79-ab73-29edfefc25c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ed6c6986644e789e3c364c2772af5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:36Z,use_quota=True,user_id='a2abb1d0830d45c5977814446db56b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4e77d2-cd19-4632-87b9-bb492ca49df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4e77d2-cd19-4632-87b9-bb492ca49df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8daae777-05a1-42cd-865e-0791332b3d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8daae777-05a1-42cd-865e-0791332b3d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6617671d-8eb0-4d79-ab73-29edfefc25c3', 'volume_name': 'volume-6617671d-8eb0-4d79-ab73-29edfefc25c3', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e802fa4-1902-4f5b-ab70-d648aa76366e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e802fa4-1902-4f5b-ab70-d648aa76366e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a602149-7925-4b1b-bbb5-609f95ec93cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:36 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Volume 6617671d-8eb0-4d79-ab73-29edfefc25c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6617671d-8eb0-4d79-ab73-29edfefc25c3', 'volume_size': 1} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:36 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c62cf871-7e0f-4712-bbfd-a03ed4ca54e2" returned: 0 in 0.467s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.840s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1977506926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aef2d719-b0a9-498a-a34f-93ddb54f9ac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ed6c6986644e789e3c364c2772af5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:34Z,use_quota=True,user_id='a2abb1d0830d45c5977814446db56b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Creating volume aef2d719-b0a9-498a-a34f-93ddb54f9ac2 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:45:36 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aef2d719-b0a9-498a-a34f-93ddb54f9ac2 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ddec82-d9df-4bcf-baeb-8ad5bf95fee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c62cf871-7e0f-4712-bbfd-a03ed4ca54e2', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b194ce6-7bfd-4910-ae7e-a3d5eff6df61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:36 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aef2d719-b0a9-498a-a34f-93ddb54f9ac2 1073741824 Nov 06 14:45:36 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:36 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Volume volume-c62cf871-7e0f-4712-bbfd-a03ed4ca54e2 (c62cf871-7e0f-4712-bbfd-a03ed4ca54e2): created successfully Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b194ce6-7bfd-4910-ae7e-a3d5eff6df61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Flow 'volume_create_manager' (fef8abfe-57cc-4d01-a50c-21fc897b3321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:36 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-bbe85c0c-eaee-4979-bd84-1e3151c52585 tempest-CreateVolumesFromImageTest-180722295 None] Created volume successfully. Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Flow 'volume_create_manager' (75ebf99f-0f61-4e8c-9edd-1f103381beca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffd155a6-aa5b-4f0e-a78d-2aaca7902220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffd155a6-aa5b-4f0e-a78d-2aaca7902220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:36Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1492238314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16bf6dd9019944409f7877376f0d7e53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:36Z,use_quota=True,user_id='6a74976d05c04ab5b206aab558ca0d91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acde2f07-f7fa-4e4a-8c10-b8f330ad4f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acde2f07-f7fa-4e4a-8c10-b8f330ad4f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d3528eb-e62a-4165-8f0c-26d9497091f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d3528eb-e62a-4165-8f0c-26d9497091f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89', 'volume_name': 'volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a707bc2-e2fa-45f9-9a37-28d56ecfb276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a707bc2-e2fa-45f9-9a37-28d56ecfb276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e946dcb-1b37-4ea4-a074-2369a0c606dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:36 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Volume 0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89', 'volume_size': 1} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:36 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aef2d719-b0a9-498a-a34f-93ddb54f9ac2 1073741824" returned: 0 in 0.541s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aef2d719-b0a9-498a-a34f-93ddb54f9ac2 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:36 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aef2d719-b0a9-498a-a34f-93ddb54f9ac2 Nov 06 14:45:36 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:37 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aef2d719-b0a9-498a-a34f-93ddb54f9ac2" returned: 0 in 0.320s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.071s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-72125044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53cb28a-6b98-4403-895a-61d1bae8c650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ed6c6986644e789e3c364c2772af5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:35Z,use_quota=True,user_id='a2abb1d0830d45c5977814446db56b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Creating volume e53cb28a-6b98-4403-895a-61d1bae8c650 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:45:37 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e53cb28a-6b98-4403-895a-61d1bae8c650 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72f558f-ccc4-4a11-96e0-c4fcc064d83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aef2d719-b0a9-498a-a34f-93ddb54f9ac2', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:37 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e53cb28a-6b98-4403-895a-61d1bae8c650 1073741824 Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (392753e5-69bc-4059-8383-53e0078393ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:37 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:37 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Volume volume-aef2d719-b0a9-498a-a34f-93ddb54f9ac2 (aef2d719-b0a9-498a-a34f-93ddb54f9ac2): created successfully Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (392753e5-69bc-4059-8383-53e0078393ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Flow 'volume_create_manager' (d902b0a1-2e9c-46d0-bbaf-f3dab2e56f0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:37 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-8d2ba574-6f2b-4f85-a491-6661ecbf3cf1 tempest-CreateVolumesFromImageTest-180722295 None] Created volume successfully. Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Flow 'volume_create_manager' (b901ab03-eb45-4445-99d4-b33bc37ba331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af0dab09-4975-4667-be89-f353d51c290a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af0dab09-4975-4667-be89-f353d51c290a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9df6ca0e-cf4f-4294-8a53-79eb51f16fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d602722a66e4e0fa16a3858a1017694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:37Z,use_quota=True,user_id='611b2de96a684626bdf2f3dfb49f2e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (614c89a4-674a-4be0-a8e8-3a5922100097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (614c89a4-674a-4be0-a8e8-3a5922100097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76e723b-9cf6-4f72-b459-217c96ba7394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG cinder.image.glance [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Creating Keystone auth plugin from conf {{(pid=86854) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76e723b-9cf6-4f72-b459-217c96ba7394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9df6ca0e-cf4f-4294-8a53-79eb51f16fb8', 'volume_name': 'volume-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8', 'volume_size': 1, 'image_id': 'aa567ae1-7a51-49d5-b17e-a469295e9eee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa567ae1-7a51-49d5-b17e-a469295e9eee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3c1888e4f82c92c8df6f222548de40df', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d602722a66e4e0fa16a3858a1017694', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8cb8d21c96c595d45f536e424251d03a78f299acb563b90d23c4d4e3a49a2abe99c9ea139c022489f0b4ecfd5e340711a464d1d09ccfe2e5702c7f601d646e6a', 'id': 'aa567ae1-7a51-49d5-b17e-a469295e9eee', 'created_at': datetime.datetime(2026, 11, 6, 13, 45, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa567ae1-7a51-49d5-b17e-a469295e9eee/file', 'properties': {}}, 'image_service': }' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b85e5b-c377-424f-ac17-b043ea665ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b85e5b-c377-424f-ac17-b043ea665ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a252a0fa-b783-45d6-b42c-f0df424109c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:37 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Volume 9df6ca0e-cf4f-4294-8a53-79eb51f16fb8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8', 'volume_size': 1, 'image_id': 'aa567ae1-7a51-49d5-b17e-a469295e9eee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa567ae1-7a51-49d5-b17e-a469295e9eee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3c1888e4f82c92c8df6f222548de40df', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d602722a66e4e0fa16a3858a1017694', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8cb8d21c96c595d45f536e424251d03a78f299acb563b90d23c4d4e3a49a2abe99c9ea139c022489f0b4ecfd5e340711a464d1d09ccfe2e5702c7f601d646e6a', 'id': 'aa567ae1-7a51-49d5-b17e-a469295e9eee', 'created_at': datetime.datetime(2026, 11, 6, 13, 45, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa567ae1-7a51-49d5-b17e-a469295e9eee/file', 'properties': {}}, 'image_service': } Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Trying to clone 9df6ca0e-cf4f-4294-8a53-79eb51f16fb8 from image aa567ae1-7a51-49d5-b17e-a469295e9eee at location (None, [{'url': 'file:///opt/stack/data/glance/images/aa567ae1-7a51-49d5-b17e-a469295e9eee', 'metadata': {}}]). {{(pid=86854) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 14:45:37 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e53cb28a-6b98-4403-895a-61d1bae8c650 1073741824" returned: 0 in 0.583s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aa567ae1-7a51-49d5-b17e-a469295e9eee_sywvjopidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 14:45:37 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Image download 0.00 MB at 0.00 MB/s Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e53cb28a-6b98-4403-895a-61d1bae8c650 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2f4308-7e94-46b3-85c9-d1dba4f8c038]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:45:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa567ae1-7a51-49d5-b17e-a469295e9eee_sywvjopidevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:37 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e53cb28a-6b98-4403-895a-61d1bae8c650 Nov 06 14:45:37 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:37 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa567ae1-7a51-49d5-b17e-a469295e9eee_sywvjopidevstack@QuobyteHD Nov 06 14:45:37 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:38 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e53cb28a-6b98-4403-895a-61d1bae8c650" returned: 0 in 0.285s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.642s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1711543937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c22ff543-6c48-4d19-a829-c1bbab6c3038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ed6c6986644e789e3c364c2772af5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:35Z,use_quota=True,user_id='a2abb1d0830d45c5977814446db56b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Creating volume c22ff543-6c48-4d19-a829-c1bbab6c3038 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:45:38 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c22ff543-6c48-4d19-a829-c1bbab6c3038 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb4063f-7500-4837-b8ae-3e85b33f55b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e53cb28a-6b98-4403-895a-61d1bae8c650', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:38 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c22ff543-6c48-4d19-a829-c1bbab6c3038 1073741824 Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304deb35-1559-4146-957c-bc6e23241df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:38 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:38 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Volume volume-e53cb28a-6b98-4403-895a-61d1bae8c650 (e53cb28a-6b98-4403-895a-61d1bae8c650): created successfully Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304deb35-1559-4146-957c-bc6e23241df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Flow 'volume_create_manager' (596dbf6b-5dcc-4f4f-a933-01760e75a84e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:38 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-080e641f-5e15-4b1a-ad79-bfe0efb4963c tempest-CreateVolumesFromImageTest-180722295 None] Created volume successfully. Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Flow 'volume_create_manager' (c86bf18e-dd48-47aa-9f32-f178d8c8fbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8fe5765-d7cc-41cd-a989-a9c14e9fbb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:38 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8fe5765-d7cc-41cd-a989-a9c14e9fbb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f17067e4-e29c-480a-8090-640babd6f984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dcd70e665494cf59e32efe38898210d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:38Z,use_quota=True,user_id='1de3f04205844406bb624dd0b726e998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b34c612d-451a-4b48-8c55-d4b8dc3faec5),volume_type_id=b34c612d-451a-4b48-8c55-d4b8dc3faec5)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeae732a-0608-4b89-a734-b40c4c78db0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeae732a-0608-4b89-a734-b40c4c78db0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34500c9f-1405-4675-b500-8e05132e6d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.image.glance [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Creating Keystone auth plugin from conf {{(pid=86854) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa567ae1-7a51-49d5-b17e-a469295e9eee_sywvjopidevstack@QuobyteHD" returned: 0 in 0.483s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa567ae1-7a51-49d5-b17e-a469295e9eee_sywvjopidevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:38 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa567ae1-7a51-49d5-b17e-a469295e9eee_sywvjopidevstack@QuobyteHD Nov 06 14:45:38 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34500c9f-1405-4675-b500-8e05132e6d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f17067e4-e29c-480a-8090-640babd6f984', 'volume_name': 'volume-f17067e4-e29c-480a-8090-640babd6f984', 'volume_size': 1, 'image_id': 'd74046b1-d45d-478c-a898-72130abda8a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d74046b1-d45d-478c-a898-72130abda8a5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4156bec9ec901bbf1339430e00171d4e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4dcd70e665494cf59e32efe38898210d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ea67d46b4198f4eeda587cbe8001dd2491c2d2315cb52f66b4783b5775304e0484ea6ba41a74ca00bba08e0208c130c3eba0a218a334cb8f39d36dc16ac21798', 'id': 'd74046b1-d45d-478c-a898-72130abda8a5', 'created_at': datetime.datetime(2026, 11, 6, 13, 45, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 45, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d74046b1-d45d-478c-a898-72130abda8a5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (794feb95-f45b-493b-8e31-d8f6ff5267e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (794feb95-f45b-493b-8e31-d8f6ff5267e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab419c7-7646-4ca8-9950-0f04bbac91c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:38 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Volume f17067e4-e29c-480a-8090-640babd6f984: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f17067e4-e29c-480a-8090-640babd6f984', 'volume_size': 1, 'image_id': 'd74046b1-d45d-478c-a898-72130abda8a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d74046b1-d45d-478c-a898-72130abda8a5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4156bec9ec901bbf1339430e00171d4e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4dcd70e665494cf59e32efe38898210d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ea67d46b4198f4eeda587cbe8001dd2491c2d2315cb52f66b4783b5775304e0484ea6ba41a74ca00bba08e0208c130c3eba0a218a334cb8f39d36dc16ac21798', 'id': 'd74046b1-d45d-478c-a898-72130abda8a5', 'created_at': datetime.datetime(2026, 11, 6, 13, 45, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 45, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d74046b1-d45d-478c-a898-72130abda8a5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Trying to clone f17067e4-e29c-480a-8090-640babd6f984 from image d74046b1-d45d-478c-a898-72130abda8a5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d74046b1-d45d-478c-a898-72130abda8a5', 'metadata': {}}]). {{(pid=86854) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d74046b1-d45d-478c-a898-72130abda8a5_sbszlp11devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 14:45:38 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Image download 0.00 MB at 0.00 MB/s Nov 06 14:45:38 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c22ff543-6c48-4d19-a829-c1bbab6c3038 1073741824" returned: 0 in 0.547s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:38 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c22ff543-6c48-4d19-a829-c1bbab6c3038 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa567ae1-7a51-49d5-b17e-a469295e9eee_sywvjopidevstack@QuobyteHD" returned: 1 in 0.403s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa567ae1-7a51-49d5-b17e-a469295e9eee_sywvjopidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Temporary image aa567ae1-7a51-49d5-b17e-a469295e9eee is fetched for user 611b2de96a684626bdf2f3dfb49f2e06. {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[f031fd5a-1bbc-4fc6-a228-5b8af3ecaa3e]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d74046b1-d45d-478c-a898-72130abda8a5_sbszlp11devstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:38 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c22ff543-6c48-4d19-a829-c1bbab6c3038 Nov 06 14:45:38 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f34942-9c7f-4b4d-8d24-eff4eaa6509a]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa567ae1-7a51-49d5-b17e-a469295e9eee_sywvjopidevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:38 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d74046b1-d45d-478c-a898-72130abda8a5_sbszlp11devstack@QuobyteHD Nov 06 14:45:38 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:38 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa567ae1-7a51-49d5-b17e-a469295e9eee_sywvjopidevstack@QuobyteHD Nov 06 14:45:38 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:38 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c22ff543-6c48-4d19-a829-c1bbab6c3038" returned: 0 in 0.257s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.777s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-569739237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6617671d-8eb0-4d79-ab73-29edfefc25c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ed6c6986644e789e3c364c2772af5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:36Z,use_quota=True,user_id='a2abb1d0830d45c5977814446db56b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Creating volume 6617671d-8eb0-4d79-ab73-29edfefc25c3 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:45:38 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:45:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6617671d-8eb0-4d79-ab73-29edfefc25c3 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d21c5a-efbe-4d23-b5d4-7a5e0038fe0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c22ff543-6c48-4d19-a829-c1bbab6c3038', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd878f7-1726-4762-897d-f07b166d0b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:39 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6617671d-8eb0-4d79-ab73-29edfefc25c3 1073741824 Nov 06 14:45:39 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:39 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Volume volume-c22ff543-6c48-4d19-a829-c1bbab6c3038 (c22ff543-6c48-4d19-a829-c1bbab6c3038): created successfully Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd878f7-1726-4762-897d-f07b166d0b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Flow 'volume_create_manager' (9aa84cb5-2bce-4930-a3b7-d67258ba1e8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:39 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-fecbb30b-a78c-4a38-9338-94a3487c7768 tempest-CreateVolumesFromImageTest-180722295 None] Created volume successfully. Nov 06 14:45:39 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d74046b1-d45d-478c-a898-72130abda8a5_sbszlp11devstack@QuobyteHD" returned: 0 in 0.350s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d74046b1-d45d-478c-a898-72130abda8a5_sbszlp11devstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:39 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa567ae1-7a51-49d5-b17e-a469295e9eee_sywvjopidevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa567ae1-7a51-49d5-b17e-a469295e9eee_sywvjopidevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:39 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d74046b1-d45d-478c-a898-72130abda8a5_sbszlp11devstack@QuobyteHD Nov 06 14:45:39 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:39 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa567ae1-7a51-49d5-b17e-a469295e9eee_sywvjopidevstack@QuobyteHD Nov 06 14:45:39 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:39 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d74046b1-d45d-478c-a898-72130abda8a5_sbszlp11devstack@QuobyteHD" returned: 1 in 0.388s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d74046b1-d45d-478c-a898-72130abda8a5_sbszlp11devstack@QuobyteHD' failed. Not Retrying. {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Temporary image d74046b1-d45d-478c-a898-72130abda8a5 is fetched for user 1de3f04205844406bb624dd0b726e998. {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c56128-d5b0-4fdf-ae91-4d9a4c277eeb]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d74046b1-d45d-478c-a898-72130abda8a5_sbszlp11devstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:39 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6617671d-8eb0-4d79-ab73-29edfefc25c3 1073741824" returned: 0 in 0.595s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:39 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa567ae1-7a51-49d5-b17e-a469295e9eee_sywvjopidevstack@QuobyteHD" returned: 1 in 0.420s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa567ae1-7a51-49d5-b17e-a469295e9eee_sywvjopidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6617671d-8eb0-4d79-ab73-29edfefc25c3 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:39 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6617671d-8eb0-4d79-ab73-29edfefc25c3 Nov 06 14:45:39 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:39 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d74046b1-d45d-478c-a898-72130abda8a5_sbszlp11devstack@QuobyteHD Nov 06 14:45:39 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:39 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6617671d-8eb0-4d79-ab73-29edfefc25c3" returned: 0 in 0.249s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.380s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:39 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:36Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1492238314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16bf6dd9019944409f7877376f0d7e53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:36Z,use_quota=True,user_id='6a74976d05c04ab5b206aab558ca0d91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Creating volume 0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:45:39 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d74046b1-d45d-478c-a898-72130abda8a5_sbszlp11devstack@QuobyteHD" returned: 0 in 0.355s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d74046b1-d45d-478c-a898-72130abda8a5_sbszlp11devstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:39 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89 1073741824 Nov 06 14:45:39 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a602149-7925-4b1b-bbb5-609f95ec93cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6617671d-8eb0-4d79-ab73-29edfefc25c3', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0d9aea-daf7-4072-9113-97621e8eb378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:39 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Volume volume-6617671d-8eb0-4d79-ab73-29edfefc25c3 (6617671d-8eb0-4d79-ab73-29edfefc25c3): created successfully Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0d9aea-daf7-4072-9113-97621e8eb378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Flow 'volume_create_manager' (a950eee3-3b98-4f76-aeb9-b13a2ed113df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:39 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-04d8d70a-134a-4040-99ec-0eb08ce65c83 tempest-CreateVolumesFromImageTest-180722295 None] Created volume successfully. Nov 06 14:45:40 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d74046b1-d45d-478c-a898-72130abda8a5_sbszlp11devstack@QuobyteHD Nov 06 14:45:40 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:40 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d74046b1-d45d-478c-a898-72130abda8a5_sbszlp11devstack@QuobyteHD" returned: 1 in 0.357s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d74046b1-d45d-478c-a898-72130abda8a5_sbszlp11devstack@QuobyteHD' failed. Not Retrying. {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 14:45:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:40 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89 1073741824" returned: 0 in 0.437s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:40 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89 Nov 06 14:45:40 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:40 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-04640689-6020-497a-914e-d22ac53c2e5f tempest-CreateVolumesFromImageTest-180722295 None] Acquiring lock "cinder-6617671d-8eb0-4d79-ab73-29edfefc25c3-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:40 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-04640689-6020-497a-914e-d22ac53c2e5f tempest-CreateVolumesFromImageTest-180722295 None] Lock "cinder-6617671d-8eb0-4d79-ab73-29edfefc25c3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:40 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-04640689-6020-497a-914e-d22ac53c2e5f tempest-CreateVolumesFromImageTest-180722295 None] Acquiring lock "cinder-quobyte-6617671d-8eb0-4d79-ab73-29edfefc25c3" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:40 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-04640689-6020-497a-914e-d22ac53c2e5f tempest-CreateVolumesFromImageTest-180722295 None] Lock "cinder-quobyte-6617671d-8eb0-4d79-ab73-29edfefc25c3" acquired by "delete_volume" :: waited 0.014s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:40 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89" returned: 0 in 0.273s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:40 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:45:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.023s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:40 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9df6ca0e-cf4f-4294-8a53-79eb51f16fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d602722a66e4e0fa16a3858a1017694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:37Z,use_quota=True,user_id='611b2de96a684626bdf2f3dfb49f2e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:45:40 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Creating volume 9df6ca0e-cf4f-4294-8a53-79eb51f16fb8 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:45:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:40 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:40 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:40 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:45:40 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:45:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:40 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82f477a-79ee-41ed-b29d-816656a681f0]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:45:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-04640689-6020-497a-914e-d22ac53c2e5f tempest-CreateVolumesFromImageTest-180722295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6617671d-8eb0-4d79-ab73-29edfefc25c3 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:40 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8 1073741824 Nov 06 14:45:40 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:40 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e946dcb-1b37-4ea4-a074-2369a0c606dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:40 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d5e53c6-4d99-4bb4-8b88-f1e18db87449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:40 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Volume volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89 (0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89): created successfully Nov 06 14:45:40 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d5e53c6-4d99-4bb4-8b88-f1e18db87449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:40 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Flow 'volume_create_manager' (75ebf99f-0f61-4e8c-9edd-1f103381beca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:40 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-03ffc38a-bf09-45bd-b67e-966a57786e80 tempest-CinderUnicodeTest-1342569683 None] Created volume successfully. Nov 06 14:45:40 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6617671d-8eb0-4d79-ab73-29edfefc25c3 Nov 06 14:45:40 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:41 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-04640689-6020-497a-914e-d22ac53c2e5f tempest-CreateVolumesFromImageTest-180722295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6617671d-8eb0-4d79-ab73-29edfefc25c3" returned: 0 in 0.382s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-04640689-6020-497a-914e-d22ac53c2e5f tempest-CreateVolumesFromImageTest-180722295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6617671d-8eb0-4d79-ab73-29edfefc25c3 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:41 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6617671d-8eb0-4d79-ab73-29edfefc25c3 Nov 06 14:45:41 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:41 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8 1073741824" returned: 0 in 0.447s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:41 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8 Nov 06 14:45:41 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:41 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-04640689-6020-497a-914e-d22ac53c2e5f tempest-CreateVolumesFromImageTest-180722295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6617671d-8eb0-4d79-ab73-29edfefc25c3" returned: 0 in 0.253s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-04640689-6020-497a-914e-d22ac53c2e5f tempest-CreateVolumesFromImageTest-180722295 None] Lock "cinder-quobyte-6617671d-8eb0-4d79-ab73-29edfefc25c3" released by "delete_volume" :: held 0.702s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-04640689-6020-497a-914e-d22ac53c2e5f tempest-CreateVolumesFromImageTest-180722295 None] Created reservations ['98a805f1-851c-45fb-b9bc-aa6086c9c834', 'd1b44f8d-194e-4677-96de-d67b66dff624', '406b8536-03f7-42f8-bbdb-2a065a902f42', 'cd01d614-a88e-42ce-afad-3613ea87b9f3'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:45:41 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8" returned: 0 in 0.263s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.131s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f17067e4-e29c-480a-8090-640babd6f984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dcd70e665494cf59e32efe38898210d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:38Z,use_quota=True,user_id='1de3f04205844406bb624dd0b726e998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b34c612d-451a-4b48-8c55-d4b8dc3faec5),volume_type_id=b34c612d-451a-4b48-8c55-d4b8dc3faec5)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Creating volume f17067e4-e29c-480a-8090-640babd6f984 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:45:41 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f17067e4-e29c-480a-8090-640babd6f984 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:41 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f17067e4-e29c-480a-8090-640babd6f984 1073741824 Nov 06 14:45:41 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Attempting download of aa567ae1-7a51-49d5-b17e-a469295e9eee ((None, [{'url': 'file:///opt/stack/data/glance/images/aa567ae1-7a51-49d5-b17e-a469295e9eee', 'metadata': {}}])) to volume 9df6ca0e-cf4f-4294-8a53-79eb51f16fb8. {{(pid=86854) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-04640689-6020-497a-914e-d22ac53c2e5f tempest-CreateVolumesFromImageTest-180722295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-04640689-6020-497a-914e-d22ac53c2e5f tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-04640689-6020-497a-914e-d22ac53c2e5f tempest-CreateVolumesFromImageTest-180722295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-04640689-6020-497a-914e-d22ac53c2e5f tempest-CreateVolumesFromImageTest-180722295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-04640689-6020-497a-914e-d22ac53c2e5f tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-04640689-6020-497a-914e-d22ac53c2e5f tempest-CreateVolumesFromImageTest-180722295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:41 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:45:41 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91d92e7-9d62-4393-bc5a-6465e5038742]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa567ae1-7a51-49d5-b17e-a469295e9eee_9c3n7e_u {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:41 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa567ae1-7a51-49d5-b17e-a469295e9eee_9c3n7e_u Nov 06 14:45:41 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f057a4a9-34c6-4b8d-8a44-e8a0979bb6c9 tempest-CreateVolumesFromImageTest-180722295 None] Acquiring lock "cinder-c22ff543-6c48-4d19-a829-c1bbab6c3038-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f057a4a9-34c6-4b8d-8a44-e8a0979bb6c9 tempest-CreateVolumesFromImageTest-180722295 None] Lock "cinder-c22ff543-6c48-4d19-a829-c1bbab6c3038-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:41 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f057a4a9-34c6-4b8d-8a44-e8a0979bb6c9 tempest-CreateVolumesFromImageTest-180722295 None] Acquiring lock "cinder-quobyte-c22ff543-6c48-4d19-a829-c1bbab6c3038" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-04640689-6020-497a-914e-d22ac53c2e5f tempest-CreateVolumesFromImageTest-180722295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.378s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-04640689-6020-497a-914e-d22ac53c2e5f tempest-CreateVolumesFromImageTest-180722295 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:45:41 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-04640689-6020-497a-914e-d22ac53c2e5f tempest-CreateVolumesFromImageTest-180722295 None] Deleted volume successfully. Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f057a4a9-34c6-4b8d-8a44-e8a0979bb6c9 tempest-CreateVolumesFromImageTest-180722295 None] Lock "cinder-quobyte-c22ff543-6c48-4d19-a829-c1bbab6c3038" acquired by "delete_volume" :: waited 0.031s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[599c717d-2e08-4605-8c7c-dfffb032ce37]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-04640689-6020-497a-914e-d22ac53c2e5f tempest-CreateVolumesFromImageTest-180722295 None] Lock "cinder-6617671d-8eb0-4d79-ab73-29edfefc25c3-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f057a4a9-34c6-4b8d-8a44-e8a0979bb6c9 tempest-CreateVolumesFromImageTest-180722295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c22ff543-6c48-4d19-a829-c1bbab6c3038 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:41 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa567ae1-7a51-49d5-b17e-a469295e9eee_9c3n7e_u" returned: 0 in 0.444s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa567ae1-7a51-49d5-b17e-a469295e9eee_9c3n7e_u {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:41 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f17067e4-e29c-480a-8090-640babd6f984 1073741824" returned: 0 in 0.592s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f17067e4-e29c-480a-8090-640babd6f984 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:42 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c22ff543-6c48-4d19-a829-c1bbab6c3038 Nov 06 14:45:42 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:42 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f17067e4-e29c-480a-8090-640babd6f984 Nov 06 14:45:42 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b293a346-3984-44f6-8e76-02e11cb7ac42 tempest-CinderUnicodeTest-1342569683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:42 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa567ae1-7a51-49d5-b17e-a469295e9eee_9c3n7e_u Nov 06 14:45:42 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:42 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa567ae1-7a51-49d5-b17e-a469295e9eee_9c3n7e_u" returned: 1 in 0.360s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa567ae1-7a51-49d5-b17e-a469295e9eee_9c3n7e_u' failed. Not Retrying. {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 14:45:42 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef715aa-1a4a-4f85-99b9-044cd266ce77]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa567ae1-7a51-49d5-b17e-a469295e9eee_sywvjopidevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:42 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f17067e4-e29c-480a-8090-640babd6f984" returned: 0 in 0.295s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b293a346-3984-44f6-8e76-02e11cb7ac42 tempest-CinderUnicodeTest-1342569683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.255s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f057a4a9-34c6-4b8d-8a44-e8a0979bb6c9 tempest-CreateVolumesFromImageTest-180722295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c22ff543-6c48-4d19-a829-c1bbab6c3038" returned: 0 in 0.431s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f057a4a9-34c6-4b8d-8a44-e8a0979bb6c9 tempest-CreateVolumesFromImageTest-180722295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c22ff543-6c48-4d19-a829-c1bbab6c3038 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:42 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c22ff543-6c48-4d19-a829-c1bbab6c3038 Nov 06 14:45:42 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-b293a346-3984-44f6-8e76-02e11cb7ac42 tempest-CinderUnicodeTest-1342569683 None] Creating offline snapshot 0e0f6ef5-35d0-413c-95ff-be5e5f1a7c1f of volume 0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Attempting download of d74046b1-d45d-478c-a898-72130abda8a5 ((None, [{'url': 'file:///opt/stack/data/glance/images/d74046b1-d45d-478c-a898-72130abda8a5', 'metadata': {}}])) to volume f17067e4-e29c-480a-8090-640babd6f984. {{(pid=86854) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd29734-96c8-4af0-83dd-403ea6962e00]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b293a346-3984-44f6-8e76-02e11cb7ac42 tempest-CinderUnicodeTest-1342569683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:42 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa567ae1-7a51-49d5-b17e-a469295e9eee_sywvjopidevstack@QuobyteHD Nov 06 14:45:42 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32c2f7d-c168-40b3-b20b-53c17dc33d34]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d74046b1-d45d-478c-a898-72130abda8a5_i6ny2tcn {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:42 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89 Nov 06 14:45:42 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:42 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:42 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d74046b1-d45d-478c-a898-72130abda8a5_i6ny2tcn Nov 06 14:45:42 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f057a4a9-34c6-4b8d-8a44-e8a0979bb6c9 tempest-CreateVolumesFromImageTest-180722295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c22ff543-6c48-4d19-a829-c1bbab6c3038" returned: 0 in 0.290s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f057a4a9-34c6-4b8d-8a44-e8a0979bb6c9 tempest-CreateVolumesFromImageTest-180722295 None] Lock "cinder-quobyte-c22ff543-6c48-4d19-a829-c1bbab6c3038" released by "delete_volume" :: held 0.798s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:42 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-f057a4a9-34c6-4b8d-8a44-e8a0979bb6c9 tempest-CreateVolumesFromImageTest-180722295 None] Created reservations ['584cd7fd-d6a2-4be3-8300-bd56277c6129', '543e2c2a-90f4-40eb-8a66-9137adfa4c94', '5ec9d12b-880a-4a31-8b4d-92b77c99a85c', '6de4df96-c560-461a-bd2d-68ebd64a9dfd'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa567ae1-7a51-49d5-b17e-a469295e9eee_sywvjopidevstack@QuobyteHD" returned: 0 in 0.442s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa567ae1-7a51-49d5-b17e-a469295e9eee_sywvjopidevstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:42 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b293a346-3984-44f6-8e76-02e11cb7ac42 tempest-CinderUnicodeTest-1342569683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89" returned: 0 in 0.412s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b293a346-3984-44f6-8e76-02e11cb7ac42 tempest-CinderUnicodeTest-1342569683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89.0e0f6ef5-35d0-413c-95ff-be5e5f1a7c1f 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:42 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89.0e0f6ef5-35d0-413c-95ff-be5e5f1a7c1f 1G Nov 06 14:45:42 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f057a4a9-34c6-4b8d-8a44-e8a0979bb6c9 tempest-CreateVolumesFromImageTest-180722295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f057a4a9-34c6-4b8d-8a44-e8a0979bb6c9 tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f057a4a9-34c6-4b8d-8a44-e8a0979bb6c9 tempest-CreateVolumesFromImageTest-180722295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:42 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f057a4a9-34c6-4b8d-8a44-e8a0979bb6c9 tempest-CreateVolumesFromImageTest-180722295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f057a4a9-34c6-4b8d-8a44-e8a0979bb6c9 tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f057a4a9-34c6-4b8d-8a44-e8a0979bb6c9 tempest-CreateVolumesFromImageTest-180722295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:42 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa567ae1-7a51-49d5-b17e-a469295e9eee_sywvjopidevstack@QuobyteHD Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d74046b1-d45d-478c-a898-72130abda8a5_i6ny2tcn" returned: 0 in 0.436s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d74046b1-d45d-478c-a898-72130abda8a5_i6ny2tcn {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:42 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:42 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:45:42 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-826506de-edab-4b2c-9fb4-effe1591de70 tempest-CreateVolumesFromImageTest-180722295 None] Acquiring lock "cinder-e53cb28a-6b98-4403-895a-61d1bae8c650-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-826506de-edab-4b2c-9fb4-effe1591de70 tempest-CreateVolumesFromImageTest-180722295 None] Lock "cinder-e53cb28a-6b98-4403-895a-61d1bae8c650-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:43 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d74046b1-d45d-478c-a898-72130abda8a5_i6ny2tcn Nov 06 14:45:43 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-826506de-edab-4b2c-9fb4-effe1591de70 tempest-CreateVolumesFromImageTest-180722295 None] Acquiring lock "cinder-quobyte-e53cb28a-6b98-4403-895a-61d1bae8c650" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-826506de-edab-4b2c-9fb4-effe1591de70 tempest-CreateVolumesFromImageTest-180722295 None] Lock "cinder-quobyte-e53cb28a-6b98-4403-895a-61d1bae8c650" acquired by "delete_volume" :: waited 0.030s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[4229af17-de74-4504-b83d-5a2397669c9d]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-826506de-edab-4b2c-9fb4-effe1591de70 tempest-CreateVolumesFromImageTest-180722295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e53cb28a-6b98-4403-895a-61d1bae8c650 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:43 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f057a4a9-34c6-4b8d-8a44-e8a0979bb6c9 tempest-CreateVolumesFromImageTest-180722295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.341s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-f057a4a9-34c6-4b8d-8a44-e8a0979bb6c9 tempest-CreateVolumesFromImageTest-180722295 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:45:43 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-f057a4a9-34c6-4b8d-8a44-e8a0979bb6c9 tempest-CreateVolumesFromImageTest-180722295 None] Deleted volume successfully. Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f057a4a9-34c6-4b8d-8a44-e8a0979bb6c9 tempest-CreateVolumesFromImageTest-180722295 None] Lock "cinder-c22ff543-6c48-4d19-a829-c1bbab6c3038-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:43 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa567ae1-7a51-49d5-b17e-a469295e9eee_sywvjopidevstack@QuobyteHD" returned: 1 in 0.543s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa567ae1-7a51-49d5-b17e-a469295e9eee_sywvjopidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] aa567ae1-7a51-49d5-b17e-a469295e9eee was raw, converting to qcow2 {{(pid=86854) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aa567ae1-7a51-49d5-b17e-a469295e9eee_sywvjopidevstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:43 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aa567ae1-7a51-49d5-b17e-a469295e9eee_sywvjopidevstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8 Nov 06 14:45:43 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:43 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e53cb28a-6b98-4403-895a-61d1bae8c650 Nov 06 14:45:43 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:43 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d74046b1-d45d-478c-a898-72130abda8a5_i6ny2tcn" returned: 1 in 0.477s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d74046b1-d45d-478c-a898-72130abda8a5_i6ny2tcn' failed. Not Retrying. {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b936e26-0b26-4279-9eef-3ff85d22cc3f]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d74046b1-d45d-478c-a898-72130abda8a5_sbszlp11devstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:43 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b293a346-3984-44f6-8e76-02e11cb7ac42 tempest-CinderUnicodeTest-1342569683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89.0e0f6ef5-35d0-413c-95ff-be5e5f1a7c1f 1G" returned: 0 in 0.617s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b293a346-3984-44f6-8e76-02e11cb7ac42 tempest-CinderUnicodeTest-1342569683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89.0e0f6ef5-35d0-413c-95ff-be5e5f1a7c1f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:43 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89.0e0f6ef5-35d0-413c-95ff-be5e5f1a7c1f Nov 06 14:45:43 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:43 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d74046b1-d45d-478c-a898-72130abda8a5_sbszlp11devstack@QuobyteHD Nov 06 14:45:43 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:43 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-826506de-edab-4b2c-9fb4-effe1591de70 tempest-CreateVolumesFromImageTest-180722295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e53cb28a-6b98-4403-895a-61d1bae8c650" returned: 0 in 0.457s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-826506de-edab-4b2c-9fb4-effe1591de70 tempest-CreateVolumesFromImageTest-180722295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e53cb28a-6b98-4403-895a-61d1bae8c650 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:43 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e53cb28a-6b98-4403-895a-61d1bae8c650 Nov 06 14:45:43 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:43 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d74046b1-d45d-478c-a898-72130abda8a5_sbszlp11devstack@QuobyteHD" returned: 0 in 0.386s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d74046b1-d45d-478c-a898-72130abda8a5_sbszlp11devstack@QuobyteHD {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:43 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b293a346-3984-44f6-8e76-02e11cb7ac42 tempest-CinderUnicodeTest-1342569683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89.0e0f6ef5-35d0-413c-95ff-be5e5f1a7c1f" returned: 0 in 0.366s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:43 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-b293a346-3984-44f6-8e76-02e11cb7ac42 tempest-CinderUnicodeTest-1342569683 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89.0e0f6ef5-35d0-413c-95ff-be5e5f1a7c1f is being set with open permissions: ugo+rw Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b293a346-3984-44f6-8e76-02e11cb7ac42 tempest-CinderUnicodeTest-1342569683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89.0e0f6ef5-35d0-413c-95ff-be5e5f1a7c1f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:43 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89.0e0f6ef5-35d0-413c-95ff-be5e5f1a7c1f Nov 06 14:45:43 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:43 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aa567ae1-7a51-49d5-b17e-a469295e9eee_sywvjopidevstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8" returned: 0 in 0.561s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aa567ae1-7a51-49d5-b17e-a469295e9eee_sywvjopidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8 {{(pid=86854) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 14:45:43 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:43 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d74046b1-d45d-478c-a898-72130abda8a5_sbszlp11devstack@QuobyteHD Nov 06 14:45:43 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:43 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8 1G Nov 06 14:45:43 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:43 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-826506de-edab-4b2c-9fb4-effe1591de70 tempest-CreateVolumesFromImageTest-180722295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e53cb28a-6b98-4403-895a-61d1bae8c650" returned: 0 in 0.270s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-826506de-edab-4b2c-9fb4-effe1591de70 tempest-CreateVolumesFromImageTest-180722295 None] Lock "cinder-quobyte-e53cb28a-6b98-4403-895a-61d1bae8c650" released by "delete_volume" :: held 0.780s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-826506de-edab-4b2c-9fb4-effe1591de70 tempest-CreateVolumesFromImageTest-180722295 None] Created reservations ['83a4d421-da85-4225-9c7d-a424a551b5b4', 'bbd74756-cf2d-4084-b524-8cf8ad84ef60', '65614c09-6155-47ad-8f09-13fc1ca326b7', 'a0e84c47-fee4-4d4f-881b-87ee2fc193a1'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:45:44 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b293a346-3984-44f6-8e76-02e11cb7ac42 tempest-CinderUnicodeTest-1342569683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89.0e0f6ef5-35d0-413c-95ff-be5e5f1a7c1f" returned: 0 in 0.279s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-826506de-edab-4b2c-9fb4-effe1591de70 tempest-CreateVolumesFromImageTest-180722295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-826506de-edab-4b2c-9fb4-effe1591de70 tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-826506de-edab-4b2c-9fb4-effe1591de70 tempest-CreateVolumesFromImageTest-180722295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-826506de-edab-4b2c-9fb4-effe1591de70 tempest-CreateVolumesFromImageTest-180722295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-826506de-edab-4b2c-9fb4-effe1591de70 tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-826506de-edab-4b2c-9fb4-effe1591de70 tempest-CreateVolumesFromImageTest-180722295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:44 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:45:44 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b293a346-3984-44f6-8e76-02e11cb7ac42 tempest-CinderUnicodeTest-1342569683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:44 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d74046b1-d45d-478c-a898-72130abda8a5_sbszlp11devstack@QuobyteHD" returned: 1 in 0.406s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d74046b1-d45d-478c-a898-72130abda8a5_sbszlp11devstack@QuobyteHD' failed. Not Retrying. {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] d74046b1-d45d-478c-a898-72130abda8a5 was raw, converting to qcow2 {{(pid=86854) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d74046b1-d45d-478c-a898-72130abda8a5_sbszlp11devstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f17067e4-e29c-480a-8090-640babd6f984 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:44 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89.info Nov 06 14:45:44 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:44 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d74046b1-d45d-478c-a898-72130abda8a5_sbszlp11devstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f17067e4-e29c-480a-8090-640babd6f984 Nov 06 14:45:44 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e672a548-123d-4875-9097-bb72cd919364 tempest-CreateVolumesFromImageTest-180722295 None] Acquiring lock "cinder-aef2d719-b0a9-498a-a34f-93ddb54f9ac2-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:44 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8 1G" returned: 0 in 0.429s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Downloaded image aa567ae1-7a51-49d5-b17e-a469295e9eee ((None, [{'url': 'file:///opt/stack/data/glance/images/aa567ae1-7a51-49d5-b17e-a469295e9eee', 'metadata': {}}])) to volume 9df6ca0e-cf4f-4294-8a53-79eb51f16fb8 successfully. {{(pid=86854) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Temporary image aa567ae1-7a51-49d5-b17e-a469295e9eee for user 611b2de96a684626bdf2f3dfb49f2e06 is deleted. {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Marking volume 9df6ca0e-cf4f-4294-8a53-79eb51f16fb8 as bootable. {{(pid=86854) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e672a548-123d-4875-9097-bb72cd919364 tempest-CreateVolumesFromImageTest-180722295 None] Lock "cinder-aef2d719-b0a9-498a-a34f-93ddb54f9ac2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Copying metadata from image aa567ae1-7a51-49d5-b17e-a469295e9eee to 9df6ca0e-cf4f-4294-8a53-79eb51f16fb8. {{(pid=86854) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Creating volume glance metadata for volume 9df6ca0e-cf4f-4294-8a53-79eb51f16fb8 backed by image aa567ae1-7a51-49d5-b17e-a469295e9eee with: {'image_id': 'aa567ae1-7a51-49d5-b17e-a469295e9eee', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3c1888e4f82c92c8df6f222548de40df', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86854) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e672a548-123d-4875-9097-bb72cd919364 tempest-CreateVolumesFromImageTest-180722295 None] Acquiring lock "cinder-quobyte-aef2d719-b0a9-498a-a34f-93ddb54f9ac2" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e672a548-123d-4875-9097-bb72cd919364 tempest-CreateVolumesFromImageTest-180722295 None] Lock "cinder-quobyte-aef2d719-b0a9-498a-a34f-93ddb54f9ac2" acquired by "delete_volume" :: waited 0.042s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:44 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-826506de-edab-4b2c-9fb4-effe1591de70 tempest-CreateVolumesFromImageTest-180722295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.345s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-826506de-edab-4b2c-9fb4-effe1591de70 tempest-CreateVolumesFromImageTest-180722295 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:45:44 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-826506de-edab-4b2c-9fb4-effe1591de70 tempest-CreateVolumesFromImageTest-180722295 None] Deleted volume successfully. Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[511fc027-ede7-4281-9f63-e4d70e343a50]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e672a548-123d-4875-9097-bb72cd919364 tempest-CreateVolumesFromImageTest-180722295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aef2d719-b0a9-498a-a34f-93ddb54f9ac2 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-826506de-edab-4b2c-9fb4-effe1591de70 tempest-CreateVolumesFromImageTest-180722295 None] Lock "cinder-e53cb28a-6b98-4403-895a-61d1bae8c650-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a252a0fa-b783-45d6-b42c-f0df424109c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8', 'volume_size': 1, 'image_id': 'aa567ae1-7a51-49d5-b17e-a469295e9eee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa567ae1-7a51-49d5-b17e-a469295e9eee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3c1888e4f82c92c8df6f222548de40df', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d602722a66e4e0fa16a3858a1017694', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8cb8d21c96c595d45f536e424251d03a78f299acb563b90d23c4d4e3a49a2abe99c9ea139c022489f0b4ecfd5e340711a464d1d09ccfe2e5702c7f601d646e6a', 'id': 'aa567ae1-7a51-49d5-b17e-a469295e9eee', 'created_at': datetime.datetime(2026, 11, 6, 13, 45, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa567ae1-7a51-49d5-b17e-a469295e9eee/file', 'properties': {}}, 'image_service': }' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179b3ba2-2110-43d3-8f34-4efc8a42c5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:44 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b293a346-3984-44f6-8e76-02e11cb7ac42 tempest-CinderUnicodeTest-1342569683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89.info" returned: 0 in 0.428s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:44 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-b293a346-3984-44f6-8e76-02e11cb7ac42 tempest-CinderUnicodeTest-1342569683 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89.info is being set with open permissions: ugo+rw Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b293a346-3984-44f6-8e76-02e11cb7ac42 tempest-CinderUnicodeTest-1342569683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:44 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Volume volume-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8 (9df6ca0e-cf4f-4294-8a53-79eb51f16fb8): created successfully Nov 06 14:45:44 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89.info Nov 06 14:45:44 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aef2d719-b0a9-498a-a34f-93ddb54f9ac2 Nov 06 14:45:44 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:44 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179b3ba2-2110-43d3-8f34-4efc8a42c5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Flow 'volume_create_manager' (b901ab03-eb45-4445-99d4-b33bc37ba331) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:44 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-2bdbc03a-0bf0-42c5-880d-095f7b760a26 tempest-VolumeImageDependencyTests-249323487 None] Created volume successfully. Nov 06 14:45:44 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d74046b1-d45d-478c-a898-72130abda8a5_sbszlp11devstack@QuobyteHD /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f17067e4-e29c-480a-8090-640babd6f984" returned: 0 in 0.631s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d74046b1-d45d-478c-a898-72130abda8a5_sbszlp11devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f17067e4-e29c-480a-8090-640babd6f984 {{(pid=86854) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 14:45:44 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f17067e4-e29c-480a-8090-640babd6f984 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:44 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f17067e4-e29c-480a-8090-640babd6f984 1G Nov 06 14:45:44 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-afeafcc3-fda9-45aa-b593-e6c14a664b70 tempest-VolumeImageDependencyTests-249323487 None] Acquiring lock "cinder-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:44 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b293a346-3984-44f6-8e76-02e11cb7ac42 tempest-CinderUnicodeTest-1342569683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89.info" returned: 0 in 0.324s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b293a346-3984-44f6-8e76-02e11cb7ac42 tempest-CinderUnicodeTest-1342569683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.612s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:44 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-afeafcc3-fda9-45aa-b593-e6c14a664b70 tempest-VolumeImageDependencyTests-249323487 None] Lock "cinder-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:45 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-b293a346-3984-44f6-8e76-02e11cb7ac42 tempest-CinderUnicodeTest-1342569683 None] Create snapshot completed successfully Nov 06 14:45:45 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-afeafcc3-fda9-45aa-b593-e6c14a664b70 tempest-VolumeImageDependencyTests-249323487 None] Acquiring lock "cinder-quobyte-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e672a548-123d-4875-9097-bb72cd919364 tempest-CreateVolumesFromImageTest-180722295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aef2d719-b0a9-498a-a34f-93ddb54f9ac2" returned: 0 in 0.540s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e672a548-123d-4875-9097-bb72cd919364 tempest-CreateVolumesFromImageTest-180722295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aef2d719-b0a9-498a-a34f-93ddb54f9ac2 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-afeafcc3-fda9-45aa-b593-e6c14a664b70 tempest-VolumeImageDependencyTests-249323487 None] Lock "cinder-quobyte-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8" acquired by "delete_volume" :: waited 0.030s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:45 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aef2d719-b0a9-498a-a34f-93ddb54f9ac2 Nov 06 14:45:45 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c80be92-e98c-454d-86fe-279f88a0360b]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-afeafcc3-fda9-45aa-b593-e6c14a664b70 tempest-VolumeImageDependencyTests-249323487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:45 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f17067e4-e29c-480a-8090-640babd6f984 1G" returned: 0 in 0.374s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Downloaded image d74046b1-d45d-478c-a898-72130abda8a5 ((None, [{'url': 'file:///opt/stack/data/glance/images/d74046b1-d45d-478c-a898-72130abda8a5', 'metadata': {}}])) to volume f17067e4-e29c-480a-8090-640babd6f984 successfully. {{(pid=86854) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Temporary image d74046b1-d45d-478c-a898-72130abda8a5 for user 1de3f04205844406bb624dd0b726e998 is deleted. {{(pid=86854) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.volume.volume_utils [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Marking volume f17067e4-e29c-480a-8090-640babd6f984 as bootable. {{(pid=86854) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 14:45:45 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8 Nov 06 14:45:45 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Copying metadata from image d74046b1-d45d-478c-a898-72130abda8a5 to f17067e4-e29c-480a-8090-640babd6f984. {{(pid=86854) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Creating volume glance metadata for volume f17067e4-e29c-480a-8090-640babd6f984 backed by image d74046b1-d45d-478c-a898-72130abda8a5 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd74046b1-d45d-478c-a898-72130abda8a5', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '4156bec9ec901bbf1339430e00171d4e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86854) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 14:45:45 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e672a548-123d-4875-9097-bb72cd919364 tempest-CreateVolumesFromImageTest-180722295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-aef2d719-b0a9-498a-a34f-93ddb54f9ac2" returned: 0 in 0.281s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e64fb522-0494-4f8f-b6d1-a98e34f93893 tempest-CinderUnicodeTest-1342569683 None] Acquiring lock "cinder-0e0f6ef5-35d0-413c-95ff-be5e5f1a7c1f-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e672a548-123d-4875-9097-bb72cd919364 tempest-CreateVolumesFromImageTest-180722295 None] Lock "cinder-quobyte-aef2d719-b0a9-498a-a34f-93ddb54f9ac2" released by "delete_volume" :: held 0.907s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab419c7-7646-4ca8-9950-0f04bbac91c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f17067e4-e29c-480a-8090-640babd6f984', 'volume_size': 1, 'image_id': 'd74046b1-d45d-478c-a898-72130abda8a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d74046b1-d45d-478c-a898-72130abda8a5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4156bec9ec901bbf1339430e00171d4e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4dcd70e665494cf59e32efe38898210d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ea67d46b4198f4eeda587cbe8001dd2491c2d2315cb52f66b4783b5775304e0484ea6ba41a74ca00bba08e0208c130c3eba0a218a334cb8f39d36dc16ac21798', 'id': 'd74046b1-d45d-478c-a898-72130abda8a5', 'created_at': datetime.datetime(2026, 11, 6, 13, 45, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 13, 45, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d74046b1-d45d-478c-a898-72130abda8a5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4326c60d-eb1c-4db0-a244-c89b66e59630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e64fb522-0494-4f8f-b6d1-a98e34f93893 tempest-CinderUnicodeTest-1342569683 None] Lock "cinder-0e0f6ef5-35d0-413c-95ff-be5e5f1a7c1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e64fb522-0494-4f8f-b6d1-a98e34f93893 tempest-CinderUnicodeTest-1342569683 None] Acquiring lock "cinder-quobyte-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:45 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Volume volume-f17067e4-e29c-480a-8090-640babd6f984 (f17067e4-e29c-480a-8090-640babd6f984): created successfully Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4326c60d-eb1c-4db0-a244-c89b66e59630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Flow 'volume_create_manager' (c86bf18e-dd48-47aa-9f32-f178d8c8fbcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e64fb522-0494-4f8f-b6d1-a98e34f93893 tempest-CinderUnicodeTest-1342569683 None] Lock "cinder-quobyte-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e64fb522-0494-4f8f-b6d1-a98e34f93893 tempest-CinderUnicodeTest-1342569683 None] Acquiring lock "cinder-quobyte-0e0f6ef5-35d0-413c-95ff-be5e5f1a7c1f" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:45 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-e676c09c-ba5f-48e4-b35a-35b51bf571ff tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Created volume successfully. Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e64fb522-0494-4f8f-b6d1-a98e34f93893 tempest-CinderUnicodeTest-1342569683 None] Lock "cinder-quobyte-0e0f6ef5-35d0-413c-95ff-be5e5f1a7c1f" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-e64fb522-0494-4f8f-b6d1-a98e34f93893 tempest-CinderUnicodeTest-1342569683 None] Deleting offline snapshot 0e0f6ef5-35d0-413c-95ff-be5e5f1a7c1f of volume 0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-e64fb522-0494-4f8f-b6d1-a98e34f93893 tempest-CinderUnicodeTest-1342569683 None] snapshot_file for this snap is: volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89.0e0f6ef5-35d0-413c-95ff-be5e5f1a7c1f {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bc931a-5b78-4d7a-8978-0a0046d6ce90]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e64fb522-0494-4f8f-b6d1-a98e34f93893 tempest-CinderUnicodeTest-1342569683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89.0e0f6ef5-35d0-413c-95ff-be5e5f1a7c1f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-e672a548-123d-4875-9097-bb72cd919364 tempest-CreateVolumesFromImageTest-180722295 None] Created reservations ['d5784846-08b0-4136-b209-6b6aaf9fb4a3', '10f4761d-c774-47c5-b15f-c4b476256203', '306604e9-36cb-4746-ac06-4b8c1854aa79', 'e21474e6-41a0-4c05-aada-81426051d10f'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:45:45 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-afeafcc3-fda9-45aa-b593-e6c14a664b70 tempest-VolumeImageDependencyTests-249323487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8" returned: 0 in 0.448s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-afeafcc3-fda9-45aa-b593-e6c14a664b70 tempest-VolumeImageDependencyTests-249323487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:45 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8 Nov 06 14:45:45 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:45 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89.0e0f6ef5-35d0-413c-95ff-be5e5f1a7c1f Nov 06 14:45:45 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e672a548-123d-4875-9097-bb72cd919364 tempest-CreateVolumesFromImageTest-180722295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e672a548-123d-4875-9097-bb72cd919364 tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e672a548-123d-4875-9097-bb72cd919364 tempest-CreateVolumesFromImageTest-180722295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e672a548-123d-4875-9097-bb72cd919364 tempest-CreateVolumesFromImageTest-180722295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e672a548-123d-4875-9097-bb72cd919364 tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e672a548-123d-4875-9097-bb72cd919364 tempest-CreateVolumesFromImageTest-180722295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:45 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:45:45 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-602f2c2d-c02e-4daa-94bf-da5b2200244c tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Acquiring lock "cinder-f17067e4-e29c-480a-8090-640babd6f984-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-602f2c2d-c02e-4daa-94bf-da5b2200244c tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Lock "cinder-f17067e4-e29c-480a-8090-640babd6f984-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-602f2c2d-c02e-4daa-94bf-da5b2200244c tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Acquiring lock "cinder-quobyte-f17067e4-e29c-480a-8090-640babd6f984" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-602f2c2d-c02e-4daa-94bf-da5b2200244c tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Lock "cinder-quobyte-f17067e4-e29c-480a-8090-640babd6f984" acquired by "delete_volume" :: waited 0.024s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[b014daef-bc68-4028-8ca0-edb5b2180808]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-602f2c2d-c02e-4daa-94bf-da5b2200244c tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f17067e4-e29c-480a-8090-640babd6f984 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:45 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-afeafcc3-fda9-45aa-b593-e6c14a664b70 tempest-VolumeImageDependencyTests-249323487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8" returned: 0 in 0.368s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-afeafcc3-fda9-45aa-b593-e6c14a664b70 tempest-VolumeImageDependencyTests-249323487 None] Lock "cinder-quobyte-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8" released by "delete_volume" :: held 0.872s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:45 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e64fb522-0494-4f8f-b6d1-a98e34f93893 tempest-CinderUnicodeTest-1342569683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89.0e0f6ef5-35d0-413c-95ff-be5e5f1a7c1f" returned: 0 in 0.488s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:45 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-e64fb522-0494-4f8f-b6d1-a98e34f93893 tempest-CinderUnicodeTest-1342569683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-afeafcc3-fda9-45aa-b593-e6c14a664b70 tempest-VolumeImageDependencyTests-249323487 None] Created reservations ['32c1c5ab-f83d-4259-9d13-8e1ec3a17405', 'd0c87ed5-dd83-4d36-941a-7257815780a2', '6b6b7f1b-ef2a-4e17-b48a-254b406c69ea', '62e95c76-4af2-4f58-9aa1-1bdd6f846adf'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:45:46 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f17067e4-e29c-480a-8090-640babd6f984 Nov 06 14:45:46 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[686adfe3-0c3c-4d48-b1b9-17e4940fa7b5]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e64fb522-0494-4f8f-b6d1-a98e34f93893 tempest-CinderUnicodeTest-1342569683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:46 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e672a548-123d-4875-9097-bb72cd919364 tempest-CreateVolumesFromImageTest-180722295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.408s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-e672a548-123d-4875-9097-bb72cd919364 tempest-CreateVolumesFromImageTest-180722295 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-afeafcc3-fda9-45aa-b593-e6c14a664b70 tempest-VolumeImageDependencyTests-249323487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-afeafcc3-fda9-45aa-b593-e6c14a664b70 tempest-VolumeImageDependencyTests-249323487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-afeafcc3-fda9-45aa-b593-e6c14a664b70 tempest-VolumeImageDependencyTests-249323487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-afeafcc3-fda9-45aa-b593-e6c14a664b70 tempest-VolumeImageDependencyTests-249323487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-afeafcc3-fda9-45aa-b593-e6c14a664b70 tempest-VolumeImageDependencyTests-249323487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-afeafcc3-fda9-45aa-b593-e6c14a664b70 tempest-VolumeImageDependencyTests-249323487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:46 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-e672a548-123d-4875-9097-bb72cd919364 tempest-CreateVolumesFromImageTest-180722295 None] Deleted volume successfully. Nov 06 14:45:46 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:45:46 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e672a548-123d-4875-9097-bb72cd919364 tempest-CreateVolumesFromImageTest-180722295 None] Lock "cinder-aef2d719-b0a9-498a-a34f-93ddb54f9ac2-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:46 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89 Nov 06 14:45:46 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:46 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-602f2c2d-c02e-4daa-94bf-da5b2200244c tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f17067e4-e29c-480a-8090-640babd6f984" returned: 0 in 0.443s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-602f2c2d-c02e-4daa-94bf-da5b2200244c tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f17067e4-e29c-480a-8090-640babd6f984 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:46 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f17067e4-e29c-480a-8090-640babd6f984 Nov 06 14:45:46 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:46 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-afeafcc3-fda9-45aa-b593-e6c14a664b70 tempest-VolumeImageDependencyTests-249323487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.298s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-afeafcc3-fda9-45aa-b593-e6c14a664b70 tempest-VolumeImageDependencyTests-249323487 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:45:46 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-afeafcc3-fda9-45aa-b593-e6c14a664b70 tempest-VolumeImageDependencyTests-249323487 None] Deleted volume successfully. Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-afeafcc3-fda9-45aa-b593-e6c14a664b70 tempest-VolumeImageDependencyTests-249323487 None] Lock "cinder-9df6ca0e-cf4f-4294-8a53-79eb51f16fb8-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:46 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e64fb522-0494-4f8f-b6d1-a98e34f93893 tempest-CinderUnicodeTest-1342569683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89" returned: 0 in 0.424s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e64fb522-0494-4f8f-b6d1-a98e34f93893 tempest-CinderUnicodeTest-1342569683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89.0e0f6ef5-35d0-413c-95ff-be5e5f1a7c1f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:46 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89.0e0f6ef5-35d0-413c-95ff-be5e5f1a7c1f Nov 06 14:45:46 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c237dac9-73e5-4b1e-a78c-6b67fa7db44c tempest-CreateVolumesFromImageTest-180722295 None] Acquiring lock "cinder-c62cf871-7e0f-4712-bbfd-a03ed4ca54e2-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c237dac9-73e5-4b1e-a78c-6b67fa7db44c tempest-CreateVolumesFromImageTest-180722295 None] Lock "cinder-c62cf871-7e0f-4712-bbfd-a03ed4ca54e2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:46 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-602f2c2d-c02e-4daa-94bf-da5b2200244c tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f17067e4-e29c-480a-8090-640babd6f984" returned: 0 in 0.301s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-602f2c2d-c02e-4daa-94bf-da5b2200244c tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Lock "cinder-quobyte-f17067e4-e29c-480a-8090-640babd6f984" released by "delete_volume" :: held 0.821s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c237dac9-73e5-4b1e-a78c-6b67fa7db44c tempest-CreateVolumesFromImageTest-180722295 None] Acquiring lock "cinder-quobyte-c62cf871-7e0f-4712-bbfd-a03ed4ca54e2" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c237dac9-73e5-4b1e-a78c-6b67fa7db44c tempest-CreateVolumesFromImageTest-180722295 None] Lock "cinder-quobyte-c62cf871-7e0f-4712-bbfd-a03ed4ca54e2" acquired by "delete_volume" :: waited 0.018s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[658690d3-d496-49b1-a88c-7173e75d7419]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c237dac9-73e5-4b1e-a78c-6b67fa7db44c tempest-CreateVolumesFromImageTest-180722295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c62cf871-7e0f-4712-bbfd-a03ed4ca54e2 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-602f2c2d-c02e-4daa-94bf-da5b2200244c tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Created reservations ['67fbdc6a-5998-4fb2-80eb-05d4b2bf025e', 'defb9a79-9dd7-42b8-8ef7-b71216babb0b', '18885982-d988-4b86-93cc-76dafca95c61', '029b4877-aef3-4dfa-9c08-d341d903fb21'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-602f2c2d-c02e-4daa-94bf-da5b2200244c tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-602f2c2d-c02e-4daa-94bf-da5b2200244c tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-602f2c2d-c02e-4daa-94bf-da5b2200244c tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-602f2c2d-c02e-4daa-94bf-da5b2200244c tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-602f2c2d-c02e-4daa-94bf-da5b2200244c tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-602f2c2d-c02e-4daa-94bf-da5b2200244c tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:46 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:45:46 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:46 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c62cf871-7e0f-4712-bbfd-a03ed4ca54e2 Nov 06 14:45:46 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:46 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e64fb522-0494-4f8f-b6d1-a98e34f93893 tempest-CinderUnicodeTest-1342569683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89.0e0f6ef5-35d0-413c-95ff-be5e5f1a7c1f" returned: 0 in 0.418s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e64fb522-0494-4f8f-b6d1-a98e34f93893 tempest-CinderUnicodeTest-1342569683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89.0e0f6ef5-35d0-413c-95ff-be5e5f1a7c1f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:46 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89.0e0f6ef5-35d0-413c-95ff-be5e5f1a7c1f Nov 06 14:45:46 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:47 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-602f2c2d-c02e-4daa-94bf-da5b2200244c tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.285s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:47 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-602f2c2d-c02e-4daa-94bf-da5b2200244c tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:45:47 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-602f2c2d-c02e-4daa-94bf-da5b2200244c tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Deleted volume successfully. Nov 06 14:45:47 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-602f2c2d-c02e-4daa-94bf-da5b2200244c tempest-VolumeAndVolumeTypeFromImageTest-591530521 None] Lock "cinder-f17067e4-e29c-480a-8090-640babd6f984-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:47 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:47 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c237dac9-73e5-4b1e-a78c-6b67fa7db44c tempest-CreateVolumesFromImageTest-180722295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c62cf871-7e0f-4712-bbfd-a03ed4ca54e2" returned: 0 in 0.497s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c237dac9-73e5-4b1e-a78c-6b67fa7db44c tempest-CreateVolumesFromImageTest-180722295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c62cf871-7e0f-4712-bbfd-a03ed4ca54e2 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e64fb522-0494-4f8f-b6d1-a98e34f93893 tempest-CinderUnicodeTest-1342569683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89.0e0f6ef5-35d0-413c-95ff-be5e5f1a7c1f" returned: 0 in 0.343s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:47 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c62cf871-7e0f-4712-bbfd-a03ed4ca54e2 Nov 06 14:45:47 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:47 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e64fb522-0494-4f8f-b6d1-a98e34f93893 tempest-CinderUnicodeTest-1342569683 None] Lock "cinder-quobyte-0e0f6ef5-35d0-413c-95ff-be5e5f1a7c1f" released by "_delete_snapshot" :: held 1.870s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:47 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e64fb522-0494-4f8f-b6d1-a98e34f93893 tempest-CinderUnicodeTest-1342569683 None] Lock "cinder-quobyte-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89" released by "delete_snapshot" :: held 1.905s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:47 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-e64fb522-0494-4f8f-b6d1-a98e34f93893 tempest-CinderUnicodeTest-1342569683 None] Created reservations ['3b9805ee-b2f0-4f73-940f-28b747b7cbea', 'ab2c226e-6048-4540-8960-91821cb0b78b', 'c6cd2f67-4275-4ee6-b356-c993054f601c', '24946af1-12ff-4dc2-bacc-8ab43c3ce083'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:45:47 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-e64fb522-0494-4f8f-b6d1-a98e34f93893 tempest-CinderUnicodeTest-1342569683 None] Delete snapshot completed successfully. Nov 06 14:45:47 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e64fb522-0494-4f8f-b6d1-a98e34f93893 tempest-CinderUnicodeTest-1342569683 None] Lock "cinder-0e0f6ef5-35d0-413c-95ff-be5e5f1a7c1f-delete_snapshot" released by "delete_snapshot" :: held 2.111s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:47 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1a80a5f9-46c8-4849-ab76-0c189e0654c0 tempest-CinderUnicodeTest-1342569683 None] Acquiring lock "cinder-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:47 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c237dac9-73e5-4b1e-a78c-6b67fa7db44c tempest-CreateVolumesFromImageTest-180722295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c62cf871-7e0f-4712-bbfd-a03ed4ca54e2" returned: 0 in 0.388s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:47 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1a80a5f9-46c8-4849-ab76-0c189e0654c0 tempest-CinderUnicodeTest-1342569683 None] Lock "cinder-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:47 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c237dac9-73e5-4b1e-a78c-6b67fa7db44c tempest-CreateVolumesFromImageTest-180722295 None] Lock "cinder-quobyte-c62cf871-7e0f-4712-bbfd-a03ed4ca54e2" released by "delete_volume" :: held 0.956s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:47 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1a80a5f9-46c8-4849-ab76-0c189e0654c0 tempest-CinderUnicodeTest-1342569683 None] Acquiring lock "cinder-quobyte-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:47 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1a80a5f9-46c8-4849-ab76-0c189e0654c0 tempest-CinderUnicodeTest-1342569683 None] Lock "cinder-quobyte-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89" acquired by "delete_volume" :: waited 0.034s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:47 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28238ce-3426-4fd9-886f-b00c93d09fc9]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:45:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1a80a5f9-46c8-4849-ab76-0c189e0654c0 tempest-CinderUnicodeTest-1342569683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:47 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-c237dac9-73e5-4b1e-a78c-6b67fa7db44c tempest-CreateVolumesFromImageTest-180722295 None] Created reservations ['5d7781bf-2239-418f-93ec-84db7e07cedc', '3b04a44f-e108-4902-8563-4645971f19c8', 'b160c05c-3c69-44c2-9365-51613547cd38', 'aecc62d7-eed2-45ed-b210-e9ca9b4ff566'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:45:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c237dac9-73e5-4b1e-a78c-6b67fa7db44c tempest-CreateVolumesFromImageTest-180722295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c237dac9-73e5-4b1e-a78c-6b67fa7db44c tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:47 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c237dac9-73e5-4b1e-a78c-6b67fa7db44c tempest-CreateVolumesFromImageTest-180722295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:47 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c237dac9-73e5-4b1e-a78c-6b67fa7db44c tempest-CreateVolumesFromImageTest-180722295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c237dac9-73e5-4b1e-a78c-6b67fa7db44c tempest-CreateVolumesFromImageTest-180722295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c237dac9-73e5-4b1e-a78c-6b67fa7db44c tempest-CreateVolumesFromImageTest-180722295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:47 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:45:47 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89 Nov 06 14:45:47 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:47 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:48 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c237dac9-73e5-4b1e-a78c-6b67fa7db44c tempest-CreateVolumesFromImageTest-180722295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.272s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:48 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-c237dac9-73e5-4b1e-a78c-6b67fa7db44c tempest-CreateVolumesFromImageTest-180722295 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:45:48 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-c237dac9-73e5-4b1e-a78c-6b67fa7db44c tempest-CreateVolumesFromImageTest-180722295 None] Deleted volume successfully. Nov 06 14:45:48 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c237dac9-73e5-4b1e-a78c-6b67fa7db44c tempest-CreateVolumesFromImageTest-180722295 None] Lock "cinder-c62cf871-7e0f-4712-bbfd-a03ed4ca54e2-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:48 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1a80a5f9-46c8-4849-ab76-0c189e0654c0 tempest-CinderUnicodeTest-1342569683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89" returned: 0 in 0.471s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1a80a5f9-46c8-4849-ab76-0c189e0654c0 tempest-CinderUnicodeTest-1342569683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:48 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89 Nov 06 14:45:48 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:48 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1a80a5f9-46c8-4849-ab76-0c189e0654c0 tempest-CinderUnicodeTest-1342569683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89" returned: 0 in 0.321s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:48 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1a80a5f9-46c8-4849-ab76-0c189e0654c0 tempest-CinderUnicodeTest-1342569683 None] Lock "cinder-quobyte-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89" released by "delete_volume" :: held 0.886s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:48 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-1a80a5f9-46c8-4849-ab76-0c189e0654c0 tempest-CinderUnicodeTest-1342569683 None] Created reservations ['821b6893-f60a-4ec3-b1f0-29c7786a65b3', '10762419-7aa9-497a-a3d7-fe3399c22594', '06ea21c6-de73-4916-8308-f563e2f999f0', '6f030fbc-d523-4a78-a30b-88cc78c1ad6a'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:45:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1a80a5f9-46c8-4849-ab76-0c189e0654c0 tempest-CinderUnicodeTest-1342569683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1a80a5f9-46c8-4849-ab76-0c189e0654c0 tempest-CinderUnicodeTest-1342569683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:48 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1a80a5f9-46c8-4849-ab76-0c189e0654c0 tempest-CinderUnicodeTest-1342569683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:48 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-1a80a5f9-46c8-4849-ab76-0c189e0654c0 tempest-CinderUnicodeTest-1342569683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-1a80a5f9-46c8-4849-ab76-0c189e0654c0 tempest-CinderUnicodeTest-1342569683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1a80a5f9-46c8-4849-ab76-0c189e0654c0 tempest-CinderUnicodeTest-1342569683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:48 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:45:48 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:49 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-1a80a5f9-46c8-4849-ab76-0c189e0654c0 tempest-CinderUnicodeTest-1342569683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.364s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:49 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-1a80a5f9-46c8-4849-ab76-0c189e0654c0 tempest-CinderUnicodeTest-1342569683 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:45:49 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-1a80a5f9-46c8-4849-ab76-0c189e0654c0 tempest-CinderUnicodeTest-1342569683 None] Deleted volume successfully. Nov 06 14:45:49 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-1a80a5f9-46c8-4849-ab76-0c189e0654c0 tempest-CinderUnicodeTest-1342569683 None] Lock "cinder-0d21c767-ddb1-4b18-9c8c-eeb9b49c6d89-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:49 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-91535845-2c87-49fb-ab17-b93ff534c8af tempest-CinderUnicodeTest-1342569683 None] Acquiring lock "cinder-f0bcb894-11e2-4a9a-8b87-5756f5a86ffe-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:49 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-91535845-2c87-49fb-ab17-b93ff534c8af tempest-CinderUnicodeTest-1342569683 None] Lock "cinder-f0bcb894-11e2-4a9a-8b87-5756f5a86ffe-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:50 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-91535845-2c87-49fb-ab17-b93ff534c8af tempest-CinderUnicodeTest-1342569683 None] Acquiring lock "cinder-quobyte-f0bcb894-11e2-4a9a-8b87-5756f5a86ffe" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:45:50 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-91535845-2c87-49fb-ab17-b93ff534c8af tempest-CinderUnicodeTest-1342569683 None] Lock "cinder-quobyte-f0bcb894-11e2-4a9a-8b87-5756f5a86ffe" acquired by "delete_volume" :: waited 0.028s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:45:50 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[35031024-2963-4bdb-83c8-b2389f89a2eb]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:45:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-91535845-2c87-49fb-ab17-b93ff534c8af tempest-CinderUnicodeTest-1342569683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f0bcb894-11e2-4a9a-8b87-5756f5a86ffe {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:50 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f0bcb894-11e2-4a9a-8b87-5756f5a86ffe Nov 06 14:45:50 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:50 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-91535845-2c87-49fb-ab17-b93ff534c8af tempest-CinderUnicodeTest-1342569683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f0bcb894-11e2-4a9a-8b87-5756f5a86ffe" returned: 0 in 0.537s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-91535845-2c87-49fb-ab17-b93ff534c8af tempest-CinderUnicodeTest-1342569683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f0bcb894-11e2-4a9a-8b87-5756f5a86ffe {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:50 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f0bcb894-11e2-4a9a-8b87-5756f5a86ffe Nov 06 14:45:50 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:50 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-91535845-2c87-49fb-ab17-b93ff534c8af tempest-CinderUnicodeTest-1342569683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f0bcb894-11e2-4a9a-8b87-5756f5a86ffe" returned: 0 in 0.307s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:50 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-91535845-2c87-49fb-ab17-b93ff534c8af tempest-CinderUnicodeTest-1342569683 None] Lock "cinder-quobyte-f0bcb894-11e2-4a9a-8b87-5756f5a86ffe" released by "delete_volume" :: held 0.907s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:51 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-91535845-2c87-49fb-ab17-b93ff534c8af tempest-CinderUnicodeTest-1342569683 None] Created reservations ['c32c1322-721e-4783-b76c-c444f891609c', 'fa1463a7-ed29-4732-8262-8a3a0b280e13', '45fe9efe-27ee-4e96-993d-65229b1476f8', '68061ba7-186d-45ef-836b-e1f277d50f4c'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:45:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-91535845-2c87-49fb-ab17-b93ff534c8af tempest-CinderUnicodeTest-1342569683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-91535845-2c87-49fb-ab17-b93ff534c8af tempest-CinderUnicodeTest-1342569683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-91535845-2c87-49fb-ab17-b93ff534c8af tempest-CinderUnicodeTest-1342569683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-91535845-2c87-49fb-ab17-b93ff534c8af tempest-CinderUnicodeTest-1342569683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-91535845-2c87-49fb-ab17-b93ff534c8af tempest-CinderUnicodeTest-1342569683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-91535845-2c87-49fb-ab17-b93ff534c8af tempest-CinderUnicodeTest-1342569683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:51 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:45:51 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:51 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-91535845-2c87-49fb-ab17-b93ff534c8af tempest-CinderUnicodeTest-1342569683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.261s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:51 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-91535845-2c87-49fb-ab17-b93ff534c8af tempest-CinderUnicodeTest-1342569683 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:45:51 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-91535845-2c87-49fb-ab17-b93ff534c8af tempest-CinderUnicodeTest-1342569683 None] Deleted volume successfully. Nov 06 14:45:51 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-91535845-2c87-49fb-ab17-b93ff534c8af tempest-CinderUnicodeTest-1342569683 None] Lock "cinder-f0bcb894-11e2-4a9a-8b87-5756f5a86ffe-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Flow 'volume_create_manager' (e900056c-b30d-4a8e-9022-4f130ba98899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa86cc29-901e-42a7-a1f0-90127eba4dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa86cc29-901e-42a7-a1f0-90127eba4dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1611278703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a87d7699-9feb-4900-958f-4ddc922c3f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e628f717774e61a7258550088b8041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:53Z,use_quota=True,user_id='e479033bbed94ee090eff1b4fe5fb891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a50923e-6839-4c2a-89f6-745ca9623834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a50923e-6839-4c2a-89f6-745ca9623834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8600f95f-2b94-4073-8936-331b4f86107b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8600f95f-2b94-4073-8936-331b4f86107b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a87d7699-9feb-4900-958f-4ddc922c3f54', 'volume_name': 'volume-a87d7699-9feb-4900-958f-4ddc922c3f54', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff304988-0de7-4dcc-9785-3bd8a5bfa28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff304988-0de7-4dcc-9785-3bd8a5bfa28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b32a85f3-9f9c-4a47-8e01-58c70f701716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:53 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Volume a87d7699-9feb-4900-958f-4ddc922c3f54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a87d7699-9feb-4900-958f-4ddc922c3f54', 'volume_size': 1} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1611278703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a87d7699-9feb-4900-958f-4ddc922c3f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e628f717774e61a7258550088b8041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:53Z,use_quota=True,user_id='e479033bbed94ee090eff1b4fe5fb891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Creating volume a87d7699-9feb-4900-958f-4ddc922c3f54 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:45:53 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:53 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54 1073741824 Nov 06 14:45:53 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Flow 'volume_create_manager' (839293a2-09fc-4ee0-9fa6-77cc8c8cce1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb5bd62-023f-490a-b4c7-0ec038ed0aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb5bd62-023f-490a-b4c7-0ec038ed0aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1802308743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3150902a-11a7-4f09-b1a4-c7e3bf63e323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='508736c682a94d92b36832bc924d200f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:54Z,use_quota=True,user_id='310b647b1fea4e9fa63d29e7823324d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c43c29f3-375c-4848-90d1-6598c8100fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c43c29f3-375c-4848-90d1-6598c8100fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe18e59-01dc-448d-95d6-091b8b094ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe18e59-01dc-448d-95d6-091b8b094ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3150902a-11a7-4f09-b1a4-c7e3bf63e323', 'volume_name': 'volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d594493-4189-4efd-a381-2bf0e45e8f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d594493-4189-4efd-a381-2bf0e45e8f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16077e6b-277f-4851-8dca-c5b5519ade74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:53 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Volume 3150902a-11a7-4f09-b1a4-c7e3bf63e323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323', 'volume_size': 1} Nov 06 14:45:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:54 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54 1073741824" returned: 0 in 0.579s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:54 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54 Nov 06 14:45:54 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:54 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54" returned: 0 in 0.278s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:45:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.612s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1802308743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3150902a-11a7-4f09-b1a4-c7e3bf63e323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='508736c682a94d92b36832bc924d200f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:54Z,use_quota=True,user_id='310b647b1fea4e9fa63d29e7823324d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:45:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Creating volume 3150902a-11a7-4f09-b1a4-c7e3bf63e323 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:45:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:45:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:45:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:45:54 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:45:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b32a85f3-9f9c-4a47-8e01-58c70f701716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a87d7699-9feb-4900-958f-4ddc922c3f54', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1227174-4e93-42e3-9666-b4ca47591187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:54 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323 1073741824 Nov 06 14:45:54 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:54 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Volume volume-a87d7699-9feb-4900-958f-4ddc922c3f54 (a87d7699-9feb-4900-958f-4ddc922c3f54): created successfully Nov 06 14:45:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1227174-4e93-42e3-9666-b4ca47591187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:54 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Flow 'volume_create_manager' (e900056c-b30d-4a8e-9022-4f130ba98899) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:54 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-6aab7524-ae9f-4cda-beba-1948ab8f2f27 tempest-CreateVolumesFromSnapshotTest-493923545 None] Created volume successfully. Nov 06 14:45:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-41da8c57-17dd-4874-9240-76ee620c11d5 tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:54 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323 1073741824" returned: 0 in 0.589s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:55 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323 Nov 06 14:45:55 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:55 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323" returned: 0 in 0.260s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:45:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-41da8c57-17dd-4874-9240-76ee620c11d5 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.334s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-41da8c57-17dd-4874-9240-76ee620c11d5 tempest-CreateVolumesFromSnapshotTest-493923545 None] Creating offline snapshot c1071e55-7d2a-4752-b8c8-ed54f09f399c of volume a87d7699-9feb-4900-958f-4ddc922c3f54 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:45:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16077e6b-277f-4851-8dca-c5b5519ade74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc535ff5-77ed-4a17-81ac-87fbf0f4b8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:55 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca9aedb-6fa5-4a3c-8182-5ce6f37fd171]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:45:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-41da8c57-17dd-4874-9240-76ee620c11d5 tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-bec8d4e8-d901-4c09-b704-94539f76cf01 tempest-ProjectAdminTests-1198354200 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3879013061523, 'free_capacity_gb': 1773.3879013061523, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86854) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 06 14:45:55 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Volume volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323 (3150902a-11a7-4f09-b1a4-c7e3bf63e323): created successfully Nov 06 14:45:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc535ff5-77ed-4a17-81ac-87fbf0f4b8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Flow 'volume_create_manager' (839293a2-09fc-4ee0-9fa6-77cc8c8cce1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:55 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-0e7e3b21-5c85-4e0f-a28f-0e7e2943ae9e tempest-VolumeDependencyTests-2108232285 None] Created volume successfully. Nov 06 14:45:55 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54 Nov 06 14:45:55 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:55 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-41da8c57-17dd-4874-9240-76ee620c11d5 tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54" returned: 0 in 0.458s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-41da8c57-17dd-4874-9240-76ee620c11d5 tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54.c1071e55-7d2a-4752-b8c8-ed54f09f399c 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:55 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54.c1071e55-7d2a-4752-b8c8-ed54f09f399c 1G Nov 06 14:45:55 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-942dd650-770d-4b7d-b9d0-88902479584c tempest-VolumeDependencyTests-2108232285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:56 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-41da8c57-17dd-4874-9240-76ee620c11d5 tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54.c1071e55-7d2a-4752-b8c8-ed54f09f399c 1G" returned: 0 in 0.551s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-41da8c57-17dd-4874-9240-76ee620c11d5 tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a87d7699-9feb-4900-958f-4ddc922c3f54 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54.c1071e55-7d2a-4752-b8c8-ed54f09f399c {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:56 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a87d7699-9feb-4900-958f-4ddc922c3f54 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54.c1071e55-7d2a-4752-b8c8-ed54f09f399c Nov 06 14:45:56 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:56 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-41da8c57-17dd-4874-9240-76ee620c11d5 tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a87d7699-9feb-4900-958f-4ddc922c3f54 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54.c1071e55-7d2a-4752-b8c8-ed54f09f399c" returned: 0 in 0.383s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:56 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-41da8c57-17dd-4874-9240-76ee620c11d5 tempest-CreateVolumesFromSnapshotTest-493923545 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54.c1071e55-7d2a-4752-b8c8-ed54f09f399c is being set with open permissions: ugo+rw Nov 06 14:45:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-41da8c57-17dd-4874-9240-76ee620c11d5 tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54.c1071e55-7d2a-4752-b8c8-ed54f09f399c {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:56 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54.c1071e55-7d2a-4752-b8c8-ed54f09f399c Nov 06 14:45:56 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:57 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-41da8c57-17dd-4874-9240-76ee620c11d5 tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54.c1071e55-7d2a-4752-b8c8-ed54f09f399c" returned: 0 in 0.305s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-41da8c57-17dd-4874-9240-76ee620c11d5 tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:57 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54.info Nov 06 14:45:57 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:57 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-41da8c57-17dd-4874-9240-76ee620c11d5 tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54.info" returned: 0 in 0.263s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:57 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-41da8c57-17dd-4874-9240-76ee620c11d5 tempest-CreateVolumesFromSnapshotTest-493923545 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54.info is being set with open permissions: ugo+rw Nov 06 14:45:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-41da8c57-17dd-4874-9240-76ee620c11d5 tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:57 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54.info Nov 06 14:45:57 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:57 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-41da8c57-17dd-4874-9240-76ee620c11d5 tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54.info" returned: 0 in 0.304s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-41da8c57-17dd-4874-9240-76ee620c11d5 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.388s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:45:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-942dd650-770d-4b7d-b9d0-88902479584c tempest-VolumeDependencyTests-2108232285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.650s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:45:57 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-942dd650-770d-4b7d-b9d0-88902479584c tempest-VolumeDependencyTests-2108232285 None] Creating offline snapshot b1ced24f-1e39-456a-b2be-6b0d7775e8dd of volume 3150902a-11a7-4f09-b1a4-c7e3bf63e323 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:45:57 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[84582e02-28a5-4c8b-81d1-92efc183c9e6]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:45:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-942dd650-770d-4b7d-b9d0-88902479584c tempest-VolumeDependencyTests-2108232285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:57 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-41da8c57-17dd-4874-9240-76ee620c11d5 tempest-CreateVolumesFromSnapshotTest-493923545 None] Create snapshot completed successfully Nov 06 14:45:57 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323 Nov 06 14:45:57 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:58 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-942dd650-770d-4b7d-b9d0-88902479584c tempest-VolumeDependencyTests-2108232285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323" returned: 0 in 0.456s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-942dd650-770d-4b7d-b9d0-88902479584c tempest-VolumeDependencyTests-2108232285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.b1ced24f-1e39-456a-b2be-6b0d7775e8dd 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:58 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.b1ced24f-1e39-456a-b2be-6b0d7775e8dd 1G Nov 06 14:45:58 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:58 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:58 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:45:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Flow 'volume_create_manager' (a8ab3486-4b4f-4426-b61c-57e7e6e09e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19c5b14d-193e-447a-ab1b-f495fc8c4a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-942dd650-770d-4b7d-b9d0-88902479584c tempest-VolumeDependencyTests-2108232285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.b1ced24f-1e39-456a-b2be-6b0d7775e8dd 1G" returned: 0 in 0.564s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-942dd650-770d-4b7d-b9d0-88902479584c tempest-VolumeDependencyTests-2108232285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.b1ced24f-1e39-456a-b2be-6b0d7775e8dd {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19c5b14d-193e-447a-ab1b-f495fc8c4a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-434850432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286ea53b-305b-4877-bed9-8b01f9a51455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e628f717774e61a7258550088b8041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:59Z,use_quota=True,user_id='e479033bbed94ee090eff1b4fe5fb891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd3b530-31af-4b99-a34e-85a70f7e95bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:58 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.b1ced24f-1e39-456a-b2be-6b0d7775e8dd Nov 06 14:45:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd3b530-31af-4b99-a34e-85a70f7e95bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:58 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (991d691f-743c-4c6b-ad7c-7f8350d34d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (991d691f-743c-4c6b-ad7c-7f8350d34d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '286ea53b-305b-4877-bed9-8b01f9a51455', 'volume_name': 'volume-286ea53b-305b-4877-bed9-8b01f9a51455', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (038df957-132e-4eee-b185-6c4091e2774c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (038df957-132e-4eee-b185-6c4091e2774c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:58 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d162d94b-d26e-418e-ad8f-4d1dbfca0dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:58 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Volume 286ea53b-305b-4877-bed9-8b01f9a51455: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-286ea53b-305b-4877-bed9-8b01f9a51455', 'volume_size': 1} Nov 06 14:45:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:59 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-942dd650-770d-4b7d-b9d0-88902479584c tempest-VolumeDependencyTests-2108232285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.b1ced24f-1e39-456a-b2be-6b0d7775e8dd" returned: 0 in 0.445s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:59 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-942dd650-770d-4b7d-b9d0-88902479584c tempest-VolumeDependencyTests-2108232285 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.b1ced24f-1e39-456a-b2be-6b0d7775e8dd is being set with open permissions: ugo+rw Nov 06 14:45:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-942dd650-770d-4b7d-b9d0-88902479584c tempest-VolumeDependencyTests-2108232285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.b1ced24f-1e39-456a-b2be-6b0d7775e8dd {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:59 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.b1ced24f-1e39-456a-b2be-6b0d7775e8dd Nov 06 14:45:59 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:59 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:45:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Flow 'volume_create_manager' (f2eac3bc-d8f9-4f57-9664-07a1e05abe16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eaeb8a1-948c-4c81-ab1d-e340caa9cc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:59 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Nov 06 14:45:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eaeb8a1-948c-4c81-ab1d-e340caa9cc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1602711033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92985596-7491-46c3-a997-97717d35a4ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e628f717774e61a7258550088b8041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:59Z,use_quota=True,user_id='e479033bbed94ee090eff1b4fe5fb891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a61cd88-bec3-4afa-8f46-9ff27497344e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a61cd88-bec3-4afa-8f46-9ff27497344e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5019f1e4-e417-437c-830e-50c21ef3301e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5019f1e4-e417-437c-830e-50c21ef3301e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92985596-7491-46c3-a997-97717d35a4ae', 'volume_name': 'volume-92985596-7491-46c3-a997-97717d35a4ae', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9862b4e2-8309-4cfd-82a0-f0d7f2f371d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9862b4e2-8309-4cfd-82a0-f0d7f2f371d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (139001e9-4f22-463c-8258-af2fadef416e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:59 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Volume 92985596-7491-46c3-a997-97717d35a4ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92985596-7491-46c3-a997-97717d35a4ae', 'volume_size': 1} Nov 06 14:45:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:45:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-942dd650-770d-4b7d-b9d0-88902479584c tempest-VolumeDependencyTests-2108232285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.b1ced24f-1e39-456a-b2be-6b0d7775e8dd" returned: 0 in 0.474s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:45:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-942dd650-770d-4b7d-b9d0-88902479584c tempest-VolumeDependencyTests-2108232285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:45:59 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.info Nov 06 14:45:59 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:45:59 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:45:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Flow 'volume_create_manager' (8352103e-ea95-467f-b56e-569a564f90ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:45:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9661c3f-d7d0-4ede-affb-3559dc643bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9661c3f-d7d0-4ede-affb-3559dc643bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-597498372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9113b13-440f-42ac-912b-70f891ac907a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e628f717774e61a7258550088b8041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:00Z,use_quota=True,user_id='e479033bbed94ee090eff1b4fe5fb891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f902347-ca86-4559-82ce-2fe605fb200b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f902347-ca86-4559-82ce-2fe605fb200b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (697aa1da-eb10-4cbc-8a06-a10c9f1d3d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (697aa1da-eb10-4cbc-8a06-a10c9f1d3d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9113b13-440f-42ac-912b-70f891ac907a', 'volume_name': 'volume-f9113b13-440f-42ac-912b-70f891ac907a', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636ea8cf-bd1c-487b-9fbd-f99bd02b7e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636ea8cf-bd1c-487b-9fbd-f99bd02b7e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:45:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9ef8808-7e65-4999-87c0-05328b2481c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:45:59 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Volume f9113b13-440f-42ac-912b-70f891ac907a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9113b13-440f-42ac-912b-70f891ac907a', 'volume_size': 1} Nov 06 14:45:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:00 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-942dd650-770d-4b7d-b9d0-88902479584c tempest-VolumeDependencyTests-2108232285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.info" returned: 0 in 0.326s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:00 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-942dd650-770d-4b7d-b9d0-88902479584c tempest-VolumeDependencyTests-2108232285 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.info is being set with open permissions: ugo+rw Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-942dd650-770d-4b7d-b9d0-88902479584c tempest-VolumeDependencyTests-2108232285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:00 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.info Nov 06 14:46:00 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Flow 'volume_create_manager' (c9e125c4-2ed6-46f1-a969-f4ba07fe6387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba3db881-7ec2-42c6-8b62-58bf3f927403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba3db881-7ec2-42c6-8b62-58bf3f927403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-792525187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd15d3b-ae42-42d6-bf7e-9ebd612f30ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e628f717774e61a7258550088b8041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:00Z,use_quota=True,user_id='e479033bbed94ee090eff1b4fe5fb891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6518f9-167a-4df4-a74f-bc784e540c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6518f9-167a-4df4-a74f-bc784e540c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfa0d29a-e137-4e21-88b6-7e46c6a8e80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfa0d29a-e137-4e21-88b6-7e46c6a8e80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bd15d3b-ae42-42d6-bf7e-9ebd612f30ee', 'volume_name': 'volume-0bd15d3b-ae42-42d6-bf7e-9ebd612f30ee', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5346b4-3505-47cf-9679-f3c6e1e3d9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5346b4-3505-47cf-9679-f3c6e1e3d9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ad84f5-0b1e-4a69-9f00-7e39e57678f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:00 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Volume 0bd15d3b-ae42-42d6-bf7e-9ebd612f30ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bd15d3b-ae42-42d6-bf7e-9ebd612f30ee', 'volume_size': 1} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:00 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-942dd650-770d-4b7d-b9d0-88902479584c tempest-VolumeDependencyTests-2108232285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.info" returned: 0 in 0.348s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-942dd650-770d-4b7d-b9d0-88902479584c tempest-VolumeDependencyTests-2108232285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.732s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.585s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-434850432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286ea53b-305b-4877-bed9-8b01f9a51455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e628f717774e61a7258550088b8041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:59Z,use_quota=True,user_id='e479033bbed94ee090eff1b4fe5fb891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Creating volume 286ea53b-305b-4877-bed9-8b01f9a51455 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:46:00 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-286ea53b-305b-4877-bed9-8b01f9a51455 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:00 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-286ea53b-305b-4877-bed9-8b01f9a51455 1073741824 Nov 06 14:46:00 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:00 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-942dd650-770d-4b7d-b9d0-88902479584c tempest-VolumeDependencyTests-2108232285 None] Create snapshot completed successfully Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Flow 'volume_create_manager' (04901c2c-bc78-47ab-88b1-49f39fe361fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ac6bda-617c-4e71-9815-4100749445f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ac6bda-617c-4e71-9815-4100749445f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1216087038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2315e29-a3e5-4b21-9720-01c1722db5cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e628f717774e61a7258550088b8041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:01Z,use_quota=True,user_id='e479033bbed94ee090eff1b4fe5fb891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff7c35e-19a2-4d31-b7a3-aa8f5ca0afde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff7c35e-19a2-4d31-b7a3-aa8f5ca0afde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4347147-2f28-4683-99bf-dd443af04e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4347147-2f28-4683-99bf-dd443af04e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2315e29-a3e5-4b21-9720-01c1722db5cd', 'volume_name': 'volume-f2315e29-a3e5-4b21-9720-01c1722db5cd', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8267cda0-497b-4448-bd94-bba085d57b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8267cda0-497b-4448-bd94-bba085d57b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e53e16a-08c6-4009-a0ae-8ad3eb698c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:00 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Volume f2315e29-a3e5-4b21-9720-01c1722db5cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2315e29-a3e5-4b21-9720-01c1722db5cd', 'volume_size': 1} Nov 06 14:46:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:01 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-286ea53b-305b-4877-bed9-8b01f9a51455 1073741824" returned: 0 in 0.579s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-286ea53b-305b-4877-bed9-8b01f9a51455 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:01 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-286ea53b-305b-4877-bed9-8b01f9a51455 Nov 06 14:46:01 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:01 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-286ea53b-305b-4877-bed9-8b01f9a51455" returned: 0 in 0.329s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:01 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:46:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.725s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:01 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1602711033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92985596-7491-46c3-a997-97717d35a4ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e628f717774e61a7258550088b8041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:45:59Z,use_quota=True,user_id='e479033bbed94ee090eff1b4fe5fb891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:46:01 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Creating volume 92985596-7491-46c3-a997-97717d35a4ae {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:46:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:01 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:01 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:01 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:46:01 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:46:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-92985596-7491-46c3-a997-97717d35a4ae 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d162d94b-d26e-418e-ad8f-4d1dbfca0dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-286ea53b-305b-4877-bed9-8b01f9a51455', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e67570f-650f-4797-aa0d-43e4a49ffe6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:01 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-92985596-7491-46c3-a997-97717d35a4ae 1073741824 Nov 06 14:46:01 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:01 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Volume volume-286ea53b-305b-4877-bed9-8b01f9a51455 (286ea53b-305b-4877-bed9-8b01f9a51455): created successfully Nov 06 14:46:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e67570f-650f-4797-aa0d-43e4a49ffe6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:01 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Flow 'volume_create_manager' (a8ab3486-4b4f-4426-b61c-57e7e6e09e4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:01 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-35256735-3611-451f-a15c-83ee00f85783 tempest-CreateVolumesFromSnapshotTest-493923545 None] Created volume successfully. Nov 06 14:46:01 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Flow 'volume_create_manager' (4faefcb2-455a-4c79-b66a-b9bd8ed9e2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36a0201-7b35-4a32-ad88-636082faa770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36a0201-7b35-4a32-ad88-636082faa770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-333932493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='508736c682a94d92b36832bc924d200f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b1ced24f-1e39-456a-b2be-6b0d7775e8dd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:02Z,use_quota=True,user_id='310b647b1fea4e9fa63d29e7823324d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b03676a6-4d93-4fcc-b0ee-d62ddf166de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:02 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b03676a6-4d93-4fcc-b0ee-d62ddf166de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9515dbc4-83f2-4faf-ace7-11decce0db36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9515dbc4-83f2-4faf-ace7-11decce0db36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4', 'volume_name': 'volume-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4', 'volume_size': 1, 'snapshot_id': 'b1ced24f-1e39-456a-b2be-6b0d7775e8dd'}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724ef1d7-c58a-4c29-b626-c5cf80c0307d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724ef1d7-c58a-4c29-b626-c5cf80c0307d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14d9064-9b70-45c8-91a9-49c834d6b9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:02 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Volume 4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4', 'volume_size': 1, 'snapshot_id': 'b1ced24f-1e39-456a-b2be-6b0d7775e8dd'} Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-92985596-7491-46c3-a997-97717d35a4ae 1073741824" returned: 0 in 0.667s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-92985596-7491-46c3-a997-97717d35a4ae {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:02 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-92985596-7491-46c3-a997-97717d35a4ae Nov 06 14:46:02 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:02 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-92985596-7491-46c3-a997-97717d35a4ae" returned: 0 in 0.256s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.483s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-597498372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9113b13-440f-42ac-912b-70f891ac907a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e628f717774e61a7258550088b8041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:00Z,use_quota=True,user_id='e479033bbed94ee090eff1b4fe5fb891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Creating volume f9113b13-440f-42ac-912b-70f891ac907a {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:46:02 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f9113b13-440f-42ac-912b-70f891ac907a 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (139001e9-4f22-463c-8258-af2fadef416e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92985596-7491-46c3-a997-97717d35a4ae', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c595a92-9a80-4eb0-ac69-922568617eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:02 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f9113b13-440f-42ac-912b-70f891ac907a 1073741824 Nov 06 14:46:02 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:02 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Volume volume-92985596-7491-46c3-a997-97717d35a4ae (92985596-7491-46c3-a997-97717d35a4ae): created successfully Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c595a92-9a80-4eb0-ac69-922568617eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:02 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Flow 'volume_create_manager' (f2eac3bc-d8f9-4f57-9664-07a1e05abe16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:02 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-3a1aa968-a92a-4cbe-852e-f5ce4ace5360 tempest-CreateVolumesFromSnapshotTest-493923545 None] Created volume successfully. Nov 06 14:46:03 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f9113b13-440f-42ac-912b-70f891ac907a 1073741824" returned: 0 in 0.627s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f9113b13-440f-42ac-912b-70f891ac907a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:03 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f9113b13-440f-42ac-912b-70f891ac907a Nov 06 14:46:03 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:03 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f9113b13-440f-42ac-912b-70f891ac907a" returned: 0 in 0.306s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:03 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:46:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.014s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:03 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-792525187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd15d3b-ae42-42d6-bf7e-9ebd612f30ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e628f717774e61a7258550088b8041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:00Z,use_quota=True,user_id='e479033bbed94ee090eff1b4fe5fb891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:46:03 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Creating volume 0bd15d3b-ae42-42d6-bf7e-9ebd612f30ee {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:46:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:03 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:03 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:03 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:46:03 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:46:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0bd15d3b-ae42-42d6-bf7e-9ebd612f30ee 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:03 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9ef8808-7e65-4999-87c0-05328b2481c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9113b13-440f-42ac-912b-70f891ac907a', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:03 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0bd15d3b-ae42-42d6-bf7e-9ebd612f30ee 1073741824 Nov 06 14:46:03 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:03 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9ec07d-9810-4b5e-98a6-f3368d30dabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:03 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Volume volume-f9113b13-440f-42ac-912b-70f891ac907a (f9113b13-440f-42ac-912b-70f891ac907a): created successfully Nov 06 14:46:03 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9ec07d-9810-4b5e-98a6-f3368d30dabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:03 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Flow 'volume_create_manager' (8352103e-ea95-467f-b56e-569a564f90ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:03 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-a1261033-50da-4a9b-8c03-94928df28e88 tempest-CreateVolumesFromSnapshotTest-493923545 None] Created volume successfully. Nov 06 14:46:03 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0bd15d3b-ae42-42d6-bf7e-9ebd612f30ee 1073741824" returned: 0 in 0.526s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0bd15d3b-ae42-42d6-bf7e-9ebd612f30ee {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:03 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0bd15d3b-ae42-42d6-bf7e-9ebd612f30ee Nov 06 14:46:03 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:04 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0bd15d3b-ae42-42d6-bf7e-9ebd612f30ee" returned: 0 in 0.260s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:04 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:46:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.449s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:04 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1216087038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2315e29-a3e5-4b21-9720-01c1722db5cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e628f717774e61a7258550088b8041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:01Z,use_quota=True,user_id='e479033bbed94ee090eff1b4fe5fb891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:46:04 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Creating volume f2315e29-a3e5-4b21-9720-01c1722db5cd {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:46:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:04 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:04 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:04 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:46:04 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:46:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f2315e29-a3e5-4b21-9720-01c1722db5cd 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ad84f5-0b1e-4a69-9f00-7e39e57678f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bd15d3b-ae42-42d6-bf7e-9ebd612f30ee', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2130fe7-dd07-429d-a7ff-8ad84dbc0652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:04 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f2315e29-a3e5-4b21-9720-01c1722db5cd 1073741824 Nov 06 14:46:04 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:04 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Volume volume-0bd15d3b-ae42-42d6-bf7e-9ebd612f30ee (0bd15d3b-ae42-42d6-bf7e-9ebd612f30ee): created successfully Nov 06 14:46:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2130fe7-dd07-429d-a7ff-8ad84dbc0652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Flow 'volume_create_manager' (c9e125c4-2ed6-46f1-a969-f4ba07fe6387) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:04 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-a85793f0-1655-43a1-89a7-52613b455562 tempest-CreateVolumesFromSnapshotTest-493923545 None] Created volume successfully. Nov 06 14:46:04 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f2315e29-a3e5-4b21-9720-01c1722db5cd 1073741824" returned: 0 in 0.489s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f2315e29-a3e5-4b21-9720-01c1722db5cd {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:04 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f2315e29-a3e5-4b21-9720-01c1722db5cd Nov 06 14:46:04 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:05 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f2315e29-a3e5-4b21-9720-01c1722db5cd" returned: 0 in 0.281s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.931s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Acquiring lock "cinder-quobyte-b1ced24f-1e39-456a-b2be-6b0d7775e8dd-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4" by "_create_volume_from_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e53e16a-08c6-4009-a0ae-8ad3eb698c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2315e29-a3e5-4b21-9720-01c1722db5cd', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23eb873c-9044-44fa-8316-33cd021b5408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Lock "cinder-quobyte-b1ced24f-1e39-456a-b2be-6b0d7775e8dd-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Creating volume 4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4 from snapshot b1ced24f-1e39-456a-b2be-6b0d7775e8dd {{(pid=86854) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Acquiring lock "cinder-quobyte-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4" by "_copy_volume_from_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:05 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Volume volume-f2315e29-a3e5-4b21-9720-01c1722db5cd (f2315e29-a3e5-4b21-9720-01c1722db5cd): created successfully Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23eb873c-9044-44fa-8316-33cd021b5408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Flow 'volume_create_manager' (04901c2c-bc78-47ab-88b1-49f39fe361fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Lock "cinder-quobyte-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] snapshot: b1ced24f-1e39-456a-b2be-6b0d7775e8dd, volume: 4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4, {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 14:46:05 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-a1bcedb9-8a35-4567-9aab-7b1cc8c6b39e tempest-CreateVolumesFromSnapshotTest-493923545 None] Created volume successfully. Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14b3138-57c9-494c-9f99-ed1eefd2296f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.b1ced24f-1e39-456a-b2be-6b0d7775e8dd {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-663494e6-8477-44c1-9608-7f440c70139a tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "cinder-f2315e29-a3e5-4b21-9720-01c1722db5cd-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-663494e6-8477-44c1-9608-7f440c70139a tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-f2315e29-a3e5-4b21-9720-01c1722db5cd-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:05 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.b1ced24f-1e39-456a-b2be-6b0d7775e8dd Nov 06 14:46:05 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-663494e6-8477-44c1-9608-7f440c70139a tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "cinder-quobyte-f2315e29-a3e5-4b21-9720-01c1722db5cd" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-663494e6-8477-44c1-9608-7f440c70139a tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-quobyte-f2315e29-a3e5-4b21-9720-01c1722db5cd" acquired by "delete_volume" :: waited 0.022s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e946c1d-93b3-4f7b-893e-7ba26989762d]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-663494e6-8477-44c1-9608-7f440c70139a tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f2315e29-a3e5-4b21-9720-01c1722db5cd {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:05 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.b1ced24f-1e39-456a-b2be-6b0d7775e8dd" returned: 0 in 0.478s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[9719dc6e-b46a-4cd6-a21e-3403d1443526]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:05 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f2315e29-a3e5-4b21-9720-01c1722db5cd Nov 06 14:46:05 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Flow 'volume_create_manager' (025d8155-5794-43cc-89d8-4293d6e48289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452acbc4-3a16-44ee-a51e-4a53f8fec6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452acbc4-3a16-44ee-a51e-4a53f8fec6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-948176272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e21deba7-ac58-4527-99e7-2943ae57d236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='babad70bf4064f0c988ad5aee77822ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:06Z,use_quota=True,user_id='874776ea9ab343e5a2850727553c4735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c30a148-219c-41c5-a8c6-93d0f6448a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c30a148-219c-41c5-a8c6-93d0f6448a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:05 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323 Nov 06 14:46:05 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96fd4e8a-e181-4010-af49-76ae72755a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96fd4e8a-e181-4010-af49-76ae72755a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e21deba7-ac58-4527-99e7-2943ae57d236', 'volume_name': 'volume-e21deba7-ac58-4527-99e7-2943ae57d236', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a16bfd-8c46-4585-b2f4-5ae5408b8194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a16bfd-8c46-4585-b2f4-5ae5408b8194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e557f53-2252-4a8d-abfe-1ea90d85ae3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:05 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Volume e21deba7-ac58-4527-99e7-2943ae57d236: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e21deba7-ac58-4527-99e7-2943ae57d236', 'volume_size': 1} Nov 06 14:46:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:06 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-663494e6-8477-44c1-9608-7f440c70139a tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f2315e29-a3e5-4b21-9720-01c1722db5cd" returned: 0 in 0.523s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-663494e6-8477-44c1-9608-7f440c70139a tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f2315e29-a3e5-4b21-9720-01c1722db5cd {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:06 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f2315e29-a3e5-4b21-9720-01c1722db5cd Nov 06 14:46:06 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:06 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323" returned: 0 in 0.490s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323 {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 14:46:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Creating direct copy from snapshot {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 14:46:06 devstack cinder-volume[86854]: DEBUG cinder.utils [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Path /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4 not found in is_blk_device check {{(pid=86854) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 14:46:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:06 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4 Nov 06 14:46:06 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:06 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-663494e6-8477-44c1-9608-7f440c70139a tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f2315e29-a3e5-4b21-9720-01c1722db5cd" returned: 0 in 0.303s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:06 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-663494e6-8477-44c1-9608-7f440c70139a tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-quobyte-f2315e29-a3e5-4b21-9720-01c1722db5cd" released by "delete_volume" :: held 0.894s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:06 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-663494e6-8477-44c1-9608-7f440c70139a tempest-CreateVolumesFromSnapshotTest-493923545 None] Created reservations ['6d769a50-a76f-4931-86b4-9a5231276a7a', 'bbda37d1-d7e2-4a62-a326-f1e7fc11c9ff', 'fdb87e9d-249d-45de-8eb0-2c8ea25839c3', '9d2d8405-199c-44e3-94fe-18f6cd12141a'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-663494e6-8477-44c1-9608-7f440c70139a tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-663494e6-8477-44c1-9608-7f440c70139a tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-663494e6-8477-44c1-9608-7f440c70139a tempest-CreateVolumesFromSnapshotTest-493923545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-663494e6-8477-44c1-9608-7f440c70139a tempest-CreateVolumesFromSnapshotTest-493923545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-663494e6-8477-44c1-9608-7f440c70139a tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-663494e6-8477-44c1-9608-7f440c70139a tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:06 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:46:06 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:06 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-663494e6-8477-44c1-9608-7f440c70139a tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.301s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:06 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-663494e6-8477-44c1-9608-7f440c70139a tempest-CreateVolumesFromSnapshotTest-493923545 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:46:06 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-663494e6-8477-44c1-9608-7f440c70139a tempest-CreateVolumesFromSnapshotTest-493923545 None] Deleted volume successfully. Nov 06 14:46:06 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-663494e6-8477-44c1-9608-7f440c70139a tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-f2315e29-a3e5-4b21-9720-01c1722db5cd-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:07 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ed8b6da2-2e39-4b3b-8fcf-a30b88eb4337 tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "cinder-0bd15d3b-ae42-42d6-bf7e-9ebd612f30ee-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:07 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ed8b6da2-2e39-4b3b-8fcf-a30b88eb4337 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-0bd15d3b-ae42-42d6-bf7e-9ebd612f30ee-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:07 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ed8b6da2-2e39-4b3b-8fcf-a30b88eb4337 tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "cinder-quobyte-0bd15d3b-ae42-42d6-bf7e-9ebd612f30ee" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:07 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ed8b6da2-2e39-4b3b-8fcf-a30b88eb4337 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-quobyte-0bd15d3b-ae42-42d6-bf7e-9ebd612f30ee" acquired by "delete_volume" :: waited 0.026s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:07 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a237ed0-3180-4d1d-936b-1d2d73817acb]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ed8b6da2-2e39-4b3b-8fcf-a30b88eb4337 tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0bd15d3b-ae42-42d6-bf7e-9ebd612f30ee {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:08 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0bd15d3b-ae42-42d6-bf7e-9ebd612f30ee Nov 06 14:46:08 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:08 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ed8b6da2-2e39-4b3b-8fcf-a30b88eb4337 tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0bd15d3b-ae42-42d6-bf7e-9ebd612f30ee" returned: 0 in 0.625s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ed8b6da2-2e39-4b3b-8fcf-a30b88eb4337 tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0bd15d3b-ae42-42d6-bf7e-9ebd612f30ee {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:08 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0bd15d3b-ae42-42d6-bf7e-9ebd612f30ee Nov 06 14:46:08 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:08 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ed8b6da2-2e39-4b3b-8fcf-a30b88eb4337 tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-0bd15d3b-ae42-42d6-bf7e-9ebd612f30ee" returned: 0 in 0.384s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ed8b6da2-2e39-4b3b-8fcf-a30b88eb4337 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-quobyte-0bd15d3b-ae42-42d6-bf7e-9ebd612f30ee" released by "delete_volume" :: held 1.115s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:09 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-ed8b6da2-2e39-4b3b-8fcf-a30b88eb4337 tempest-CreateVolumesFromSnapshotTest-493923545 None] Created reservations ['ff3e8472-ef52-4e3e-bb4f-b2874deb1ca5', 'cacaa805-1864-4f3f-bd9e-2aa43ee662a8', '9035e29a-c9ff-45d1-9a80-37d33dd717ec', '6f5c1cd3-623b-4215-95a5-820c3c0a1f58'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ed8b6da2-2e39-4b3b-8fcf-a30b88eb4337 tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ed8b6da2-2e39-4b3b-8fcf-a30b88eb4337 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ed8b6da2-2e39-4b3b-8fcf-a30b88eb4337 tempest-CreateVolumesFromSnapshotTest-493923545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ed8b6da2-2e39-4b3b-8fcf-a30b88eb4337 tempest-CreateVolumesFromSnapshotTest-493923545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ed8b6da2-2e39-4b3b-8fcf-a30b88eb4337 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ed8b6da2-2e39-4b3b-8fcf-a30b88eb4337 tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:09 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:46:09 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:09 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ed8b6da2-2e39-4b3b-8fcf-a30b88eb4337 tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.309s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:09 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-ed8b6da2-2e39-4b3b-8fcf-a30b88eb4337 tempest-CreateVolumesFromSnapshotTest-493923545 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:46:09 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-ed8b6da2-2e39-4b3b-8fcf-a30b88eb4337 tempest-CreateVolumesFromSnapshotTest-493923545 None] Deleted volume successfully. Nov 06 14:46:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-ed8b6da2-2e39-4b3b-8fcf-a30b88eb4337 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-0bd15d3b-ae42-42d6-bf7e-9ebd612f30ee-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:10 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-38014a08-4865-460f-baee-6b164076e81e tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "cinder-f9113b13-440f-42ac-912b-70f891ac907a-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:10 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-38014a08-4865-460f-baee-6b164076e81e tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-f9113b13-440f-42ac-912b-70f891ac907a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:10 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-38014a08-4865-460f-baee-6b164076e81e tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "cinder-quobyte-f9113b13-440f-42ac-912b-70f891ac907a" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:10 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-38014a08-4865-460f-baee-6b164076e81e tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-quobyte-f9113b13-440f-42ac-912b-70f891ac907a" acquired by "delete_volume" :: waited 0.027s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:10 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d7e8ea-542b-477c-971f-9fff7e0a52d5]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-38014a08-4865-460f-baee-6b164076e81e tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f9113b13-440f-42ac-912b-70f891ac907a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:10 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:46:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Flow 'volume_create_manager' (3c37a52e-f9d7-4ffa-8b50-d1b0836c1db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880083cd-bb8b-4fe0-89bd-7bb1f517ba1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880083cd-bb8b-4fe0-89bd-7bb1f517ba1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2069975437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f861e77a-f2c9-4c2d-aaec-c514a1e7f55f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dfa21f2c669444b9ad12849f6cf7158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:11Z,use_quota=True,user_id='758016edb3e54b24b0a15dee3c95db0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:10 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f9113b13-440f-42ac-912b-70f891ac907a Nov 06 14:46:10 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b8bc3b9-dc9a-49e9-a55f-17b100c3f1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b8bc3b9-dc9a-49e9-a55f-17b100c3f1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16cf40c0-0001-4b90-8ab9-466c55642e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16cf40c0-0001-4b90-8ab9-466c55642e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f861e77a-f2c9-4c2d-aaec-c514a1e7f55f', 'volume_name': 'volume-f861e77a-f2c9-4c2d-aaec-c514a1e7f55f', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d96eb791-9ad2-48f2-9a4d-b9ad28f4f22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d96eb791-9ad2-48f2-9a4d-b9ad28f4f22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:10 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e3e97b-7e48-42d1-8d05-9c0ee664a75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:10 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Volume f861e77a-f2c9-4c2d-aaec-c514a1e7f55f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f861e77a-f2c9-4c2d-aaec-c514a1e7f55f', 'volume_size': 1} Nov 06 14:46:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:11 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-38014a08-4865-460f-baee-6b164076e81e tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f9113b13-440f-42ac-912b-70f891ac907a" returned: 0 in 0.814s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-38014a08-4865-460f-baee-6b164076e81e tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f9113b13-440f-42ac-912b-70f891ac907a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:11 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f9113b13-440f-42ac-912b-70f891ac907a Nov 06 14:46:11 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:11 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-38014a08-4865-460f-baee-6b164076e81e tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f9113b13-440f-42ac-912b-70f891ac907a" returned: 0 in 0.330s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-38014a08-4865-460f-baee-6b164076e81e tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-quobyte-f9113b13-440f-42ac-912b-70f891ac907a" released by "delete_volume" :: held 1.274s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:11 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-38014a08-4865-460f-baee-6b164076e81e tempest-CreateVolumesFromSnapshotTest-493923545 None] Created reservations ['ce3f1ce7-93b3-4164-8871-dc0946e3c8b9', '7fa1d7bb-7cce-4d95-91f0-5bd826c493e1', 'b0de00f3-3a58-40f6-853f-24752806fe1f', 'f1295dea-e923-4bd4-befc-4df1ca6f4e84'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-38014a08-4865-460f-baee-6b164076e81e tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-38014a08-4865-460f-baee-6b164076e81e tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:11 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-38014a08-4865-460f-baee-6b164076e81e tempest-CreateVolumesFromSnapshotTest-493923545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:11 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-38014a08-4865-460f-baee-6b164076e81e tempest-CreateVolumesFromSnapshotTest-493923545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-38014a08-4865-460f-baee-6b164076e81e tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-38014a08-4865-460f-baee-6b164076e81e tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:11 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:46:11 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:12 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-38014a08-4865-460f-baee-6b164076e81e tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.265s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:12 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-38014a08-4865-460f-baee-6b164076e81e tempest-CreateVolumesFromSnapshotTest-493923545 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:46:12 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-38014a08-4865-460f-baee-6b164076e81e tempest-CreateVolumesFromSnapshotTest-493923545 None] Deleted volume successfully. Nov 06 14:46:12 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-38014a08-4865-460f-baee-6b164076e81e tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-f9113b13-440f-42ac-912b-70f891ac907a-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:12 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c228a1a3-acfb-444e-994e-01c9db9b335c tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "cinder-92985596-7491-46c3-a997-97717d35a4ae-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:12 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c228a1a3-acfb-444e-994e-01c9db9b335c tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-92985596-7491-46c3-a997-97717d35a4ae-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:12 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c228a1a3-acfb-444e-994e-01c9db9b335c tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "cinder-quobyte-92985596-7491-46c3-a997-97717d35a4ae" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:12 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c228a1a3-acfb-444e-994e-01c9db9b335c tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-quobyte-92985596-7491-46c3-a997-97717d35a4ae" acquired by "delete_volume" :: waited 0.027s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:12 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cdebe5-a9ff-49f1-b7f2-615caf70c61b]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c228a1a3-acfb-444e-994e-01c9db9b335c tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-92985596-7491-46c3-a997-97717d35a4ae {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:13 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-92985596-7491-46c3-a997-97717d35a4ae Nov 06 14:46:13 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:13 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c228a1a3-acfb-444e-994e-01c9db9b335c tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-92985596-7491-46c3-a997-97717d35a4ae" returned: 0 in 0.658s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c228a1a3-acfb-444e-994e-01c9db9b335c tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-92985596-7491-46c3-a997-97717d35a4ae {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:13 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-92985596-7491-46c3-a997-97717d35a4ae Nov 06 14:46:13 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:13 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4" returned: 0 in 7.757s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:13 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Image conversion details: src /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323, size 1024.00 MB, duration 7.76 sec, destination /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4 {{(pid=86854) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 14:46:13 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Converted 1024.00 MB image at 131.99 MB/s Nov 06 14:46:13 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4 is being set with open permissions: ugo+rw Nov 06 14:46:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:13 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4 Nov 06 14:46:13 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:14 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c228a1a3-acfb-444e-994e-01c9db9b335c tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-92985596-7491-46c3-a997-97717d35a4ae" returned: 0 in 0.416s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c228a1a3-acfb-444e-994e-01c9db9b335c tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-quobyte-92985596-7491-46c3-a997-97717d35a4ae" released by "delete_volume" :: held 1.161s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-c228a1a3-acfb-444e-994e-01c9db9b335c tempest-CreateVolumesFromSnapshotTest-493923545 None] Created reservations ['c6a5dc92-ed15-4fdf-86dd-539070705912', 'eacca959-f1f3-4d82-bb05-ccd7bba04b5e', '72c0caf6-4283-4b92-b1e8-7a9da5dfe00f', 'e267a30e-c3ef-4d5b-94bf-f226b1b9c26e'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c228a1a3-acfb-444e-994e-01c9db9b335c tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c228a1a3-acfb-444e-994e-01c9db9b335c tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c228a1a3-acfb-444e-994e-01c9db9b335c tempest-CreateVolumesFromSnapshotTest-493923545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c228a1a3-acfb-444e-994e-01c9db9b335c tempest-CreateVolumesFromSnapshotTest-493923545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c228a1a3-acfb-444e-994e-01c9db9b335c tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c228a1a3-acfb-444e-994e-01c9db9b335c tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:14 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:46:14 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:14 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4" returned: 0 in 0.249s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Lock "cinder-quobyte-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4" released by "_copy_volume_from_snapshot" :: held 9.105s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Lock "cinder-quobyte-b1ced24f-1e39-456a-b2be-6b0d7775e8dd-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4" released by "_create_volume_from_snapshot" :: held 9.195s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.240s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.379s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-948176272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e21deba7-ac58-4527-99e7-2943ae57d236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='babad70bf4064f0c988ad5aee77822ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:06Z,use_quota=True,user_id='874776ea9ab343e5a2850727553c4735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Creating volume e21deba7-ac58-4527-99e7-2943ae57d236 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:46:14 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:14 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236 1073741824 Nov 06 14:46:14 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14d9064-9b70-45c8-91a9-49c834d6b9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4', 'volume_size': 1, 'snapshot_id': 'b1ced24f-1e39-456a-b2be-6b0d7775e8dd'}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60e18f7-365d-4afc-97b4-7d985085246f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:14 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Volume volume-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4 (4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4): created successfully Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60e18f7-365d-4afc-97b4-7d985085246f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Flow 'volume_create_manager' (4faefcb2-455a-4c79-b66a-b9bd8ed9e2a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:14 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-d90cb438-a23a-4e36-bb0d-ff77d4bba531 tempest-VolumeDependencyTests-2108232285 None] Created volume successfully. Nov 06 14:46:14 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c228a1a3-acfb-444e-994e-01c9db9b335c tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.249s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-c228a1a3-acfb-444e-994e-01c9db9b335c tempest-CreateVolumesFromSnapshotTest-493923545 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:46:14 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-c228a1a3-acfb-444e-994e-01c9db9b335c tempest-CreateVolumesFromSnapshotTest-493923545 None] Deleted volume successfully. Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c228a1a3-acfb-444e-994e-01c9db9b335c tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-92985596-7491-46c3-a997-97717d35a4ae-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:14 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236 1073741824" returned: 0 in 0.404s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:14 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236 Nov 06 14:46:14 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:14 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236" returned: 0 in 0.239s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.156s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2069975437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f861e77a-f2c9-4c2d-aaec-c514a1e7f55f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dfa21f2c669444b9ad12849f6cf7158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:11Z,use_quota=True,user_id='758016edb3e54b24b0a15dee3c95db0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Creating volume f861e77a-f2c9-4c2d-aaec-c514a1e7f55f {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:46:14 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f861e77a-f2c9-4c2d-aaec-c514a1e7f55f 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e557f53-2252-4a8d-abfe-1ea90d85ae3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e21deba7-ac58-4527-99e7-2943ae57d236', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:14 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f861e77a-f2c9-4c2d-aaec-c514a1e7f55f 1073741824 Nov 06 14:46:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4edf314-ace6-4ad6-9a86-cf941e964fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:14 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:15 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Volume volume-e21deba7-ac58-4527-99e7-2943ae57d236 (e21deba7-ac58-4527-99e7-2943ae57d236): created successfully Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4edf314-ace6-4ad6-9a86-cf941e964fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Flow 'volume_create_manager' (025d8155-5794-43cc-89d8-4293d6e48289) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:15 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-eb4db23e-ff41-43f2-a81e-91d00de829a2 tempest-ProjectMemberTests-1693853425 None] Created volume successfully. Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-113972a7-78bd-4204-a2df-ee33cb0f97a9 tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "cinder-286ea53b-305b-4877-bed9-8b01f9a51455-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-113972a7-78bd-4204-a2df-ee33cb0f97a9 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-286ea53b-305b-4877-bed9-8b01f9a51455-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-113972a7-78bd-4204-a2df-ee33cb0f97a9 tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "cinder-quobyte-286ea53b-305b-4877-bed9-8b01f9a51455" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-113972a7-78bd-4204-a2df-ee33cb0f97a9 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-quobyte-286ea53b-305b-4877-bed9-8b01f9a51455" acquired by "delete_volume" :: waited 0.029s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f33e2a6-3824-42ed-9f37-874c2a3fd1ff]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-113972a7-78bd-4204-a2df-ee33cb0f97a9 tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-286ea53b-305b-4877-bed9-8b01f9a51455 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-87be8a11-7c31-450b-ab3e-39d5b3648d83 tempest-VolumeDependencyTests-2108232285 None] Acquiring lock "cinder-b1ced24f-1e39-456a-b2be-6b0d7775e8dd-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-87be8a11-7c31-450b-ab3e-39d5b3648d83 tempest-VolumeDependencyTests-2108232285 None] Lock "cinder-b1ced24f-1e39-456a-b2be-6b0d7775e8dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-87be8a11-7c31-450b-ab3e-39d5b3648d83 tempest-VolumeDependencyTests-2108232285 None] Acquiring lock "cinder-quobyte-3150902a-11a7-4f09-b1a4-c7e3bf63e323" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-87be8a11-7c31-450b-ab3e-39d5b3648d83 tempest-VolumeDependencyTests-2108232285 None] Lock "cinder-quobyte-3150902a-11a7-4f09-b1a4-c7e3bf63e323" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-87be8a11-7c31-450b-ab3e-39d5b3648d83 tempest-VolumeDependencyTests-2108232285 None] Acquiring lock "cinder-quobyte-b1ced24f-1e39-456a-b2be-6b0d7775e8dd" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-87be8a11-7c31-450b-ab3e-39d5b3648d83 tempest-VolumeDependencyTests-2108232285 None] Lock "cinder-quobyte-b1ced24f-1e39-456a-b2be-6b0d7775e8dd" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-87be8a11-7c31-450b-ab3e-39d5b3648d83 tempest-VolumeDependencyTests-2108232285 None] Deleting offline snapshot b1ced24f-1e39-456a-b2be-6b0d7775e8dd of volume 3150902a-11a7-4f09-b1a4-c7e3bf63e323 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-87be8a11-7c31-450b-ab3e-39d5b3648d83 tempest-VolumeDependencyTests-2108232285 None] snapshot_file for this snap is: volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.b1ced24f-1e39-456a-b2be-6b0d7775e8dd {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[4446d0a6-f6c3-446f-9522-ec861e3da4ee]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-87be8a11-7c31-450b-ab3e-39d5b3648d83 tempest-VolumeDependencyTests-2108232285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.b1ced24f-1e39-456a-b2be-6b0d7775e8dd {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:15 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-286ea53b-305b-4877-bed9-8b01f9a51455 Nov 06 14:46:15 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:15 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.b1ced24f-1e39-456a-b2be-6b0d7775e8dd Nov 06 14:46:15 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:15 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f861e77a-f2c9-4c2d-aaec-c514a1e7f55f 1073741824" returned: 0 in 0.496s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f861e77a-f2c9-4c2d-aaec-c514a1e7f55f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:15 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f861e77a-f2c9-4c2d-aaec-c514a1e7f55f Nov 06 14:46:15 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:15 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-113972a7-78bd-4204-a2df-ee33cb0f97a9 tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-286ea53b-305b-4877-bed9-8b01f9a51455" returned: 0 in 0.408s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-113972a7-78bd-4204-a2df-ee33cb0f97a9 tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-286ea53b-305b-4877-bed9-8b01f9a51455 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:15 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-286ea53b-305b-4877-bed9-8b01f9a51455 Nov 06 14:46:15 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:15 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-87be8a11-7c31-450b-ab3e-39d5b3648d83 tempest-VolumeDependencyTests-2108232285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.b1ced24f-1e39-456a-b2be-6b0d7775e8dd" returned: 0 in 0.387s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-87be8a11-7c31-450b-ab3e-39d5b3648d83 tempest-VolumeDependencyTests-2108232285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[9beb3779-4321-487c-a44b-e9fef8850bb0]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-87be8a11-7c31-450b-ab3e-39d5b3648d83 tempest-VolumeDependencyTests-2108232285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:15 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f861e77a-f2c9-4c2d-aaec-c514a1e7f55f" returned: 0 in 0.266s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e3e97b-7e48-42d1-8d05-9c0ee664a75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f861e77a-f2c9-4c2d-aaec-c514a1e7f55f', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f43e44-5400-4100-82e9-f1454904230a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:15 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323 Nov 06 14:46:15 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:15 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Volume volume-f861e77a-f2c9-4c2d-aaec-c514a1e7f55f (f861e77a-f2c9-4c2d-aaec-c514a1e7f55f): created successfully Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f43e44-5400-4100-82e9-f1454904230a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Flow 'volume_create_manager' (3c37a52e-f9d7-4ffa-8b50-d1b0836c1db7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:15 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-07811405-8546-489e-808b-ac773b4bd0bd tempest-ProjectReaderTests-333247446 None] Created volume successfully. Nov 06 14:46:15 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-113972a7-78bd-4204-a2df-ee33cb0f97a9 tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-286ea53b-305b-4877-bed9-8b01f9a51455" returned: 0 in 0.294s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-113972a7-78bd-4204-a2df-ee33cb0f97a9 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-quobyte-286ea53b-305b-4877-bed9-8b01f9a51455" released by "delete_volume" :: held 0.768s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:15 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-113972a7-78bd-4204-a2df-ee33cb0f97a9 tempest-CreateVolumesFromSnapshotTest-493923545 None] Created reservations ['69c53d14-1ddb-4f62-a350-1f486800c533', 'bbaf461c-a383-479c-9416-4b5968a467f4', '2c59a0e7-90e2-419a-84ea-3f33ed4a94d5', 'af4313bc-6f41-4081-90e5-a1e230062c21'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-113972a7-78bd-4204-a2df-ee33cb0f97a9 tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-113972a7-78bd-4204-a2df-ee33cb0f97a9 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-113972a7-78bd-4204-a2df-ee33cb0f97a9 tempest-CreateVolumesFromSnapshotTest-493923545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-113972a7-78bd-4204-a2df-ee33cb0f97a9 tempest-CreateVolumesFromSnapshotTest-493923545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-113972a7-78bd-4204-a2df-ee33cb0f97a9 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-113972a7-78bd-4204-a2df-ee33cb0f97a9 tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:16 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:46:16 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-69558147-e7bc-4720-9837-41fa47c8ad86 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-69558147-e7bc-4720-9837-41fa47c8ad86 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-69558147-e7bc-4720-9837-41fa47c8ad86 tempest-ProjectMemberTests-1693853425 None] Creating offline snapshot bc276cc0-bbc2-4924-b604-74ecf9768fe0 of volume e21deba7-ac58-4527-99e7-2943ae57d236 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bb1c191e-5e94-4c84-afd4-8858def1b073 tempest-ProjectReaderTests-333247446 None] Acquiring lock "cinder-f861e77a-f2c9-4c2d-aaec-c514a1e7f55f-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93a923c-b8e2-44e3-b4cc-3e60a58c8a89]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-69558147-e7bc-4720-9837-41fa47c8ad86 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bb1c191e-5e94-4c84-afd4-8858def1b073 tempest-ProjectReaderTests-333247446 None] Lock "cinder-f861e77a-f2c9-4c2d-aaec-c514a1e7f55f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bff04cf6-a7be-4345-ae6c-ebfb0049f701 tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "cinder-c1071e55-7d2a-4752-b8c8-ed54f09f399c-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:16 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bb1c191e-5e94-4c84-afd4-8858def1b073 tempest-ProjectReaderTests-333247446 None] Acquiring lock "cinder-quobyte-f861e77a-f2c9-4c2d-aaec-c514a1e7f55f" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:16 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-87be8a11-7c31-450b-ab3e-39d5b3648d83 tempest-VolumeDependencyTests-2108232285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323" returned: 0 in 0.759s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-87be8a11-7c31-450b-ab3e-39d5b3648d83 tempest-VolumeDependencyTests-2108232285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.b1ced24f-1e39-456a-b2be-6b0d7775e8dd {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bff04cf6-a7be-4345-ae6c-ebfb0049f701 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-c1071e55-7d2a-4752-b8c8-ed54f09f399c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bff04cf6-a7be-4345-ae6c-ebfb0049f701 tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "cinder-quobyte-a87d7699-9feb-4900-958f-4ddc922c3f54" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-113972a7-78bd-4204-a2df-ee33cb0f97a9 tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.440s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-113972a7-78bd-4204-a2df-ee33cb0f97a9 tempest-CreateVolumesFromSnapshotTest-493923545 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:46:16 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.b1ced24f-1e39-456a-b2be-6b0d7775e8dd Nov 06 14:46:16 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bb1c191e-5e94-4c84-afd4-8858def1b073 tempest-ProjectReaderTests-333247446 None] Lock "cinder-quobyte-f861e77a-f2c9-4c2d-aaec-c514a1e7f55f" acquired by "delete_volume" :: waited 0.049s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:16 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-113972a7-78bd-4204-a2df-ee33cb0f97a9 tempest-CreateVolumesFromSnapshotTest-493923545 None] Deleted volume successfully. Nov 06 14:46:16 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236 Nov 06 14:46:16 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bff04cf6-a7be-4345-ae6c-ebfb0049f701 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-quobyte-a87d7699-9feb-4900-958f-4ddc922c3f54" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bff04cf6-a7be-4345-ae6c-ebfb0049f701 tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "cinder-quobyte-c1071e55-7d2a-4752-b8c8-ed54f09f399c" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[3736e3e3-501e-49f3-b919-098d10afc46c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bb1c191e-5e94-4c84-afd4-8858def1b073 tempest-ProjectReaderTests-333247446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f861e77a-f2c9-4c2d-aaec-c514a1e7f55f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-113972a7-78bd-4204-a2df-ee33cb0f97a9 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-286ea53b-305b-4877-bed9-8b01f9a51455-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bff04cf6-a7be-4345-ae6c-ebfb0049f701 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-quobyte-c1071e55-7d2a-4752-b8c8-ed54f09f399c" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-bff04cf6-a7be-4345-ae6c-ebfb0049f701 tempest-CreateVolumesFromSnapshotTest-493923545 None] Deleting offline snapshot c1071e55-7d2a-4752-b8c8-ed54f09f399c of volume a87d7699-9feb-4900-958f-4ddc922c3f54 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-bff04cf6-a7be-4345-ae6c-ebfb0049f701 tempest-CreateVolumesFromSnapshotTest-493923545 None] snapshot_file for this snap is: volume-a87d7699-9feb-4900-958f-4ddc922c3f54.c1071e55-7d2a-4752-b8c8-ed54f09f399c {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8ec43f-7aef-4a39-835d-0014f643e354]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bff04cf6-a7be-4345-ae6c-ebfb0049f701 tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54.c1071e55-7d2a-4752-b8c8-ed54f09f399c {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:16 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f861e77a-f2c9-4c2d-aaec-c514a1e7f55f Nov 06 14:46:16 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:16 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54.c1071e55-7d2a-4752-b8c8-ed54f09f399c Nov 06 14:46:16 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:16 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-69558147-e7bc-4720-9837-41fa47c8ad86 tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236" returned: 0 in 0.485s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-69558147-e7bc-4720-9837-41fa47c8ad86 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236.bc276cc0-bbc2-4924-b604-74ecf9768fe0 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:16 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236.bc276cc0-bbc2-4924-b604-74ecf9768fe0 1G Nov 06 14:46:16 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:16 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-87be8a11-7c31-450b-ab3e-39d5b3648d83 tempest-VolumeDependencyTests-2108232285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.b1ced24f-1e39-456a-b2be-6b0d7775e8dd" returned: 0 in 0.455s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-87be8a11-7c31-450b-ab3e-39d5b3648d83 tempest-VolumeDependencyTests-2108232285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.b1ced24f-1e39-456a-b2be-6b0d7775e8dd {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:16 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.b1ced24f-1e39-456a-b2be-6b0d7775e8dd Nov 06 14:46:16 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:17 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bb1c191e-5e94-4c84-afd4-8858def1b073 tempest-ProjectReaderTests-333247446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f861e77a-f2c9-4c2d-aaec-c514a1e7f55f" returned: 0 in 0.477s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bb1c191e-5e94-4c84-afd4-8858def1b073 tempest-ProjectReaderTests-333247446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f861e77a-f2c9-4c2d-aaec-c514a1e7f55f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:17 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f861e77a-f2c9-4c2d-aaec-c514a1e7f55f Nov 06 14:46:17 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:17 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bff04cf6-a7be-4345-ae6c-ebfb0049f701 tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54.c1071e55-7d2a-4752-b8c8-ed54f09f399c" returned: 0 in 0.435s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-bff04cf6-a7be-4345-ae6c-ebfb0049f701 tempest-CreateVolumesFromSnapshotTest-493923545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a87d7699-9feb-4900-958f-4ddc922c3f54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab6d63f-941b-4b40-a822-5702e78e764e]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bff04cf6-a7be-4345-ae6c-ebfb0049f701 tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:17 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-87be8a11-7c31-450b-ab3e-39d5b3648d83 tempest-VolumeDependencyTests-2108232285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323.b1ced24f-1e39-456a-b2be-6b0d7775e8dd" returned: 0 in 0.264s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-87be8a11-7c31-450b-ab3e-39d5b3648d83 tempest-VolumeDependencyTests-2108232285 None] Lock "cinder-quobyte-b1ced24f-1e39-456a-b2be-6b0d7775e8dd" released by "_delete_snapshot" :: held 1.976s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-87be8a11-7c31-450b-ab3e-39d5b3648d83 tempest-VolumeDependencyTests-2108232285 None] Lock "cinder-quobyte-3150902a-11a7-4f09-b1a4-c7e3bf63e323" released by "delete_snapshot" :: held 1.998s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:17 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54 Nov 06 14:46:17 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-87be8a11-7c31-450b-ab3e-39d5b3648d83 tempest-VolumeDependencyTests-2108232285 None] Created reservations ['e077d0e6-93d9-4473-b6b3-f513afe89695', '487300d0-dc12-4c4b-b909-d3b00b1fa9d1', '9518b73d-e9d7-4935-8fed-12c7d28a7efd', '85c6f531-59fd-45ab-8d67-06b16531e69f'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:17 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bb1c191e-5e94-4c84-afd4-8858def1b073 tempest-ProjectReaderTests-333247446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f861e77a-f2c9-4c2d-aaec-c514a1e7f55f" returned: 0 in 0.328s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bb1c191e-5e94-4c84-afd4-8858def1b073 tempest-ProjectReaderTests-333247446 None] Lock "cinder-quobyte-f861e77a-f2c9-4c2d-aaec-c514a1e7f55f" released by "delete_volume" :: held 0.872s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:17 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-69558147-e7bc-4720-9837-41fa47c8ad86 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236.bc276cc0-bbc2-4924-b604-74ecf9768fe0 1G" returned: 0 in 0.535s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-69558147-e7bc-4720-9837-41fa47c8ad86 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e21deba7-ac58-4527-99e7-2943ae57d236 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236.bc276cc0-bbc2-4924-b604-74ecf9768fe0 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:17 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e21deba7-ac58-4527-99e7-2943ae57d236 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236.bc276cc0-bbc2-4924-b604-74ecf9768fe0 Nov 06 14:46:17 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:17 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-87be8a11-7c31-450b-ab3e-39d5b3648d83 tempest-VolumeDependencyTests-2108232285 None] Delete snapshot completed successfully. Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-bb1c191e-5e94-4c84-afd4-8858def1b073 tempest-ProjectReaderTests-333247446 None] Created reservations ['32423aba-cb02-4df2-99a3-2e699fe1dde9', '65e4ed57-8d68-4b3d-8599-96b1756ea747', 'ed060bf8-63e6-4b68-b248-b9bb200f027f', 'e78b3656-07bb-4f6c-af6b-9ba508456ae7'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-87be8a11-7c31-450b-ab3e-39d5b3648d83 tempest-VolumeDependencyTests-2108232285 None] Lock "cinder-b1ced24f-1e39-456a-b2be-6b0d7775e8dd-delete_snapshot" released by "delete_snapshot" :: held 2.245s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-bb1c191e-5e94-4c84-afd4-8858def1b073 tempest-ProjectReaderTests-333247446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-bb1c191e-5e94-4c84-afd4-8858def1b073 tempest-ProjectReaderTests-333247446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-bb1c191e-5e94-4c84-afd4-8858def1b073 tempest-ProjectReaderTests-333247446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-bb1c191e-5e94-4c84-afd4-8858def1b073 tempest-ProjectReaderTests-333247446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-bb1c191e-5e94-4c84-afd4-8858def1b073 tempest-ProjectReaderTests-333247446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bb1c191e-5e94-4c84-afd4-8858def1b073 tempest-ProjectReaderTests-333247446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:17 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bff04cf6-a7be-4345-ae6c-ebfb0049f701 tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54" returned: 0 in 0.472s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bff04cf6-a7be-4345-ae6c-ebfb0049f701 tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54.c1071e55-7d2a-4752-b8c8-ed54f09f399c {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:17 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:46:17 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:17 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54.c1071e55-7d2a-4752-b8c8-ed54f09f399c Nov 06 14:46:17 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:17 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-69558147-e7bc-4720-9837-41fa47c8ad86 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e21deba7-ac58-4527-99e7-2943ae57d236 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236.bc276cc0-bbc2-4924-b604-74ecf9768fe0" returned: 0 in 0.350s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:17 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-69558147-e7bc-4720-9837-41fa47c8ad86 tempest-ProjectMemberTests-1693853425 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236.bc276cc0-bbc2-4924-b604-74ecf9768fe0 is being set with open permissions: ugo+rw Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-69558147-e7bc-4720-9837-41fa47c8ad86 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236.bc276cc0-bbc2-4924-b604-74ecf9768fe0 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:17 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236.bc276cc0-bbc2-4924-b604-74ecf9768fe0 Nov 06 14:46:17 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:17 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bb1c191e-5e94-4c84-afd4-8858def1b073 tempest-ProjectReaderTests-333247446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.256s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-bb1c191e-5e94-4c84-afd4-8858def1b073 tempest-ProjectReaderTests-333247446 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:46:17 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-bb1c191e-5e94-4c84-afd4-8858def1b073 tempest-ProjectReaderTests-333247446 None] Deleted volume successfully. Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bb1c191e-5e94-4c84-afd4-8858def1b073 tempest-ProjectReaderTests-333247446 None] Lock "cinder-f861e77a-f2c9-4c2d-aaec-c514a1e7f55f-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:17 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bff04cf6-a7be-4345-ae6c-ebfb0049f701 tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54.c1071e55-7d2a-4752-b8c8-ed54f09f399c" returned: 0 in 0.360s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bff04cf6-a7be-4345-ae6c-ebfb0049f701 tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54.c1071e55-7d2a-4752-b8c8-ed54f09f399c {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:17 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54.c1071e55-7d2a-4752-b8c8-ed54f09f399c Nov 06 14:46:17 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:18 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-69558147-e7bc-4720-9837-41fa47c8ad86 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236.bc276cc0-bbc2-4924-b604-74ecf9768fe0" returned: 0 in 0.273s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-69558147-e7bc-4720-9837-41fa47c8ad86 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:18 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236.info Nov 06 14:46:18 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:18 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bff04cf6-a7be-4345-ae6c-ebfb0049f701 tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54.c1071e55-7d2a-4752-b8c8-ed54f09f399c" returned: 0 in 0.259s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bff04cf6-a7be-4345-ae6c-ebfb0049f701 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-quobyte-c1071e55-7d2a-4752-b8c8-ed54f09f399c" released by "_delete_snapshot" :: held 1.661s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bff04cf6-a7be-4345-ae6c-ebfb0049f701 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-quobyte-a87d7699-9feb-4900-958f-4ddc922c3f54" released by "delete_snapshot" :: held 1.726s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:18 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-69558147-e7bc-4720-9837-41fa47c8ad86 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236.info" returned: 0 in 0.267s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:18 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-69558147-e7bc-4720-9837-41fa47c8ad86 tempest-ProjectMemberTests-1693853425 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236.info is being set with open permissions: ugo+rw Nov 06 14:46:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-69558147-e7bc-4720-9837-41fa47c8ad86 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:18 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-bff04cf6-a7be-4345-ae6c-ebfb0049f701 tempest-CreateVolumesFromSnapshotTest-493923545 None] Created reservations ['d5d2cae5-bc9b-4aa9-af50-74c7cf2e37d9', '87111293-31db-4fb9-a8ae-fdfbc82ad85e', '68724241-68a0-493a-9499-5e79a108b683', '98936343-e128-4c88-88c9-085c4c62b692'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:18 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236.info Nov 06 14:46:18 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:18 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-bff04cf6-a7be-4345-ae6c-ebfb0049f701 tempest-CreateVolumesFromSnapshotTest-493923545 None] Delete snapshot completed successfully. Nov 06 14:46:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bff04cf6-a7be-4345-ae6c-ebfb0049f701 tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-c1071e55-7d2a-4752-b8c8-ed54f09f399c-delete_snapshot" released by "delete_snapshot" :: held 1.926s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a32e928f-c099-424b-90d5-f9895d1c9037 tempest-VolumeDependencyTests-2108232285 None] Acquiring lock "cinder-3150902a-11a7-4f09-b1a4-c7e3bf63e323-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a32e928f-c099-424b-90d5-f9895d1c9037 tempest-VolumeDependencyTests-2108232285 None] Lock "cinder-3150902a-11a7-4f09-b1a4-c7e3bf63e323-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a32e928f-c099-424b-90d5-f9895d1c9037 tempest-VolumeDependencyTests-2108232285 None] Acquiring lock "cinder-quobyte-3150902a-11a7-4f09-b1a4-c7e3bf63e323" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a32e928f-c099-424b-90d5-f9895d1c9037 tempest-VolumeDependencyTests-2108232285 None] Lock "cinder-quobyte-3150902a-11a7-4f09-b1a4-c7e3bf63e323" acquired by "delete_volume" :: waited 0.014s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:18 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-69558147-e7bc-4720-9837-41fa47c8ad86 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236.info" returned: 0 in 0.283s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-69558147-e7bc-4720-9837-41fa47c8ad86 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.304s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:18 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[7132fa63-134e-47fa-a70a-0336e5ba4e68]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a32e928f-c099-424b-90d5-f9895d1c9037 tempest-VolumeDependencyTests-2108232285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e544b951-959e-4741-8069-d01e6445552b tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "cinder-a87d7699-9feb-4900-958f-4ddc922c3f54-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e544b951-959e-4741-8069-d01e6445552b tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-a87d7699-9feb-4900-958f-4ddc922c3f54-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:18 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-69558147-e7bc-4720-9837-41fa47c8ad86 tempest-ProjectMemberTests-1693853425 None] Create snapshot completed successfully Nov 06 14:46:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e544b951-959e-4741-8069-d01e6445552b tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "cinder-quobyte-a87d7699-9feb-4900-958f-4ddc922c3f54" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:18 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323 Nov 06 14:46:18 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e544b951-959e-4741-8069-d01e6445552b tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-quobyte-a87d7699-9feb-4900-958f-4ddc922c3f54" acquired by "delete_volume" :: waited 0.026s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:18 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a438665-19e4-4a58-a18a-0c17d63ee84c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e544b951-959e-4741-8069-d01e6445552b tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:18 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54 Nov 06 14:46:18 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:19 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a32e928f-c099-424b-90d5-f9895d1c9037 tempest-VolumeDependencyTests-2108232285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323" returned: 0 in 0.418s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a32e928f-c099-424b-90d5-f9895d1c9037 tempest-VolumeDependencyTests-2108232285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:19 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323 Nov 06 14:46:19 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Flow 'volume_create_manager' (231929e9-4801-4205-b8db-b8600603f8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15b14a7-ef5f-4ba0-90a5-6575df510d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15b14a7-ef5f-4ba0-90a5-6575df510d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-945049101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d8b120-bd96-4fb1-a4d0-fd470f2ddd6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dfa21f2c669444b9ad12849f6cf7158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:19Z,use_quota=True,user_id='758016edb3e54b24b0a15dee3c95db0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d61b832-2d27-472f-8f4b-a5f3010f336e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d61b832-2d27-472f-8f4b-a5f3010f336e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11bd63d2-76c6-4b51-920f-07fc14a0fd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11bd63d2-76c6-4b51-920f-07fc14a0fd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48d8b120-bd96-4fb1-a4d0-fd470f2ddd6e', 'volume_name': 'volume-48d8b120-bd96-4fb1-a4d0-fd470f2ddd6e', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:19 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df099f13-dcec-4f74-8e15-2ca192a4ed2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df099f13-dcec-4f74-8e15-2ca192a4ed2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e06915-6162-45dc-b53f-5e4b302e9ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:19 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Volume 48d8b120-bd96-4fb1-a4d0-fd470f2ddd6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48d8b120-bd96-4fb1-a4d0-fd470f2ddd6e', 'volume_size': 1} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-945049101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d8b120-bd96-4fb1-a4d0-fd470f2ddd6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dfa21f2c669444b9ad12849f6cf7158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:19Z,use_quota=True,user_id='758016edb3e54b24b0a15dee3c95db0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Creating volume 48d8b120-bd96-4fb1-a4d0-fd470f2ddd6e {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:46:19 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48d8b120-bd96-4fb1-a4d0-fd470f2ddd6e 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e544b951-959e-4741-8069-d01e6445552b tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54" returned: 0 in 0.453s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e544b951-959e-4741-8069-d01e6445552b tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:19 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48d8b120-bd96-4fb1-a4d0-fd470f2ddd6e 1073741824 Nov 06 14:46:19 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:19 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54 Nov 06 14:46:19 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:19 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a32e928f-c099-424b-90d5-f9895d1c9037 tempest-VolumeDependencyTests-2108232285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3150902a-11a7-4f09-b1a4-c7e3bf63e323" returned: 0 in 0.277s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a32e928f-c099-424b-90d5-f9895d1c9037 tempest-VolumeDependencyTests-2108232285 None] Lock "cinder-quobyte-3150902a-11a7-4f09-b1a4-c7e3bf63e323" released by "delete_volume" :: held 0.816s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-a32e928f-c099-424b-90d5-f9895d1c9037 tempest-VolumeDependencyTests-2108232285 None] Created reservations ['ab9cc8d7-4ead-4c50-a0b6-8e93c12109b0', '520cdaf8-0a46-4786-ba56-780031b0522a', '6e62c5ff-8a0d-4cef-8285-12560d41de6b', '2ec97a64-78eb-4785-adbe-2357504de7a8'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a32e928f-c099-424b-90d5-f9895d1c9037 tempest-VolumeDependencyTests-2108232285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a32e928f-c099-424b-90d5-f9895d1c9037 tempest-VolumeDependencyTests-2108232285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a32e928f-c099-424b-90d5-f9895d1c9037 tempest-VolumeDependencyTests-2108232285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a32e928f-c099-424b-90d5-f9895d1c9037 tempest-VolumeDependencyTests-2108232285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a32e928f-c099-424b-90d5-f9895d1c9037 tempest-VolumeDependencyTests-2108232285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a32e928f-c099-424b-90d5-f9895d1c9037 tempest-VolumeDependencyTests-2108232285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-acce7d8a-655a-4143-8533-1511fa51cf47 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-bc276cc0-bbc2-4924-b604-74ecf9768fe0-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:19 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:46:19 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:19 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e544b951-959e-4741-8069-d01e6445552b tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a87d7699-9feb-4900-958f-4ddc922c3f54" returned: 0 in 0.286s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-acce7d8a-655a-4143-8533-1511fa51cf47 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-bc276cc0-bbc2-4924-b604-74ecf9768fe0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-acce7d8a-655a-4143-8533-1511fa51cf47 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-quobyte-e21deba7-ac58-4527-99e7-2943ae57d236" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e544b951-959e-4741-8069-d01e6445552b tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-quobyte-a87d7699-9feb-4900-958f-4ddc922c3f54" released by "delete_volume" :: held 0.821s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-acce7d8a-655a-4143-8533-1511fa51cf47 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-e21deba7-ac58-4527-99e7-2943ae57d236" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-acce7d8a-655a-4143-8533-1511fa51cf47 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-quobyte-bc276cc0-bbc2-4924-b604-74ecf9768fe0" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-acce7d8a-655a-4143-8533-1511fa51cf47 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-bc276cc0-bbc2-4924-b604-74ecf9768fe0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-acce7d8a-655a-4143-8533-1511fa51cf47 tempest-ProjectMemberTests-1693853425 None] Deleting offline snapshot bc276cc0-bbc2-4924-b604-74ecf9768fe0 of volume e21deba7-ac58-4527-99e7-2943ae57d236 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-acce7d8a-655a-4143-8533-1511fa51cf47 tempest-ProjectMemberTests-1693853425 None] snapshot_file for this snap is: volume-e21deba7-ac58-4527-99e7-2943ae57d236.bc276cc0-bbc2-4924-b604-74ecf9768fe0 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8cc427-073e-45f7-962f-ac2541b00c33]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-acce7d8a-655a-4143-8533-1511fa51cf47 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236.bc276cc0-bbc2-4924-b604-74ecf9768fe0 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-74ff08f4-0c40-4ec4-ab3b-b63f7ae8a3a0 tempest-VolumeDependencyTests-2108232285 None] Acquiring lock "cinder-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-e544b951-959e-4741-8069-d01e6445552b tempest-CreateVolumesFromSnapshotTest-493923545 None] Created reservations ['6161d141-72cb-41aa-9154-d48d5a72d220', '221b8708-0ac4-4abd-9d91-f843dcf80bf8', '6b997023-917b-4602-9b32-e680f069ebc4', '3e6c8473-4e8f-488f-a73c-80f811e19c97'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-74ff08f4-0c40-4ec4-ab3b-b63f7ae8a3a0 tempest-VolumeDependencyTests-2108232285 None] Lock "cinder-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-74ff08f4-0c40-4ec4-ab3b-b63f7ae8a3a0 tempest-VolumeDependencyTests-2108232285 None] Acquiring lock "cinder-quobyte-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-74ff08f4-0c40-4ec4-ab3b-b63f7ae8a3a0 tempest-VolumeDependencyTests-2108232285 None] Lock "cinder-quobyte-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4" acquired by "delete_volume" :: waited 0.034s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[8181dd54-f86f-4ef6-956b-c29ed688e8f9]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74ff08f4-0c40-4ec4-ab3b-b63f7ae8a3a0 tempest-VolumeDependencyTests-2108232285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:19 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236.bc276cc0-bbc2-4924-b604-74ecf9768fe0 Nov 06 14:46:19 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:19 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e544b951-959e-4741-8069-d01e6445552b tempest-CreateVolumesFromSnapshotTest-493923545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:19 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e544b951-959e-4741-8069-d01e6445552b tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e544b951-959e-4741-8069-d01e6445552b tempest-CreateVolumesFromSnapshotTest-493923545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e544b951-959e-4741-8069-d01e6445552b tempest-CreateVolumesFromSnapshotTest-493923545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e544b951-959e-4741-8069-d01e6445552b tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e544b951-959e-4741-8069-d01e6445552b tempest-CreateVolumesFromSnapshotTest-493923545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48d8b120-bd96-4fb1-a4d0-fd470f2ddd6e 1073741824" returned: 0 in 0.675s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a32e928f-c099-424b-90d5-f9895d1c9037 tempest-VolumeDependencyTests-2108232285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.432s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-a32e928f-c099-424b-90d5-f9895d1c9037 tempest-VolumeDependencyTests-2108232285 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:46:19 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-a32e928f-c099-424b-90d5-f9895d1c9037 tempest-VolumeDependencyTests-2108232285 None] Deleted volume successfully. Nov 06 14:46:19 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:46:19 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a32e928f-c099-424b-90d5-f9895d1c9037 tempest-VolumeDependencyTests-2108232285 None] Lock "cinder-3150902a-11a7-4f09-b1a4-c7e3bf63e323-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48d8b120-bd96-4fb1-a4d0-fd470f2ddd6e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:20 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48d8b120-bd96-4fb1-a4d0-fd470f2ddd6e Nov 06 14:46:20 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:20 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4 Nov 06 14:46:20 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:20 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e544b951-959e-4741-8069-d01e6445552b tempest-CreateVolumesFromSnapshotTest-493923545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.348s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:20 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-e544b951-959e-4741-8069-d01e6445552b tempest-CreateVolumesFromSnapshotTest-493923545 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:46:20 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-e544b951-959e-4741-8069-d01e6445552b tempest-CreateVolumesFromSnapshotTest-493923545 None] Deleted volume successfully. Nov 06 14:46:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e544b951-959e-4741-8069-d01e6445552b tempest-CreateVolumesFromSnapshotTest-493923545 None] Lock "cinder-a87d7699-9feb-4900-958f-4ddc922c3f54-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:20 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48d8b120-bd96-4fb1-a4d0-fd470f2ddd6e" returned: 0 in 0.361s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:46:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:20 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-acce7d8a-655a-4143-8533-1511fa51cf47 tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236.bc276cc0-bbc2-4924-b604-74ecf9768fe0" returned: 0 in 0.693s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-acce7d8a-655a-4143-8533-1511fa51cf47 tempest-ProjectMemberTests-1693853425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e21deba7-ac58-4527-99e7-2943ae57d236(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:46:20 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e06915-6162-45dc-b53f-5e4b302e9ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48d8b120-bd96-4fb1-a4d0-fd470f2ddd6e', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d50b6806-84af-48a1-b89e-7e59cd09d4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:20 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[b871f57c-69a7-44b4-9c1d-b012078e532c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-acce7d8a-655a-4143-8533-1511fa51cf47 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74ff08f4-0c40-4ec4-ab3b-b63f7ae8a3a0 tempest-VolumeDependencyTests-2108232285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4" returned: 0 in 0.547s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74ff08f4-0c40-4ec4-ab3b-b63f7ae8a3a0 tempest-VolumeDependencyTests-2108232285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:20 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Volume volume-48d8b120-bd96-4fb1-a4d0-fd470f2ddd6e (48d8b120-bd96-4fb1-a4d0-fd470f2ddd6e): created successfully Nov 06 14:46:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d50b6806-84af-48a1-b89e-7e59cd09d4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:20 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4 Nov 06 14:46:20 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Flow 'volume_create_manager' (231929e9-4801-4205-b8db-b8600603f8cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:20 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-090869e1-14b9-4e4b-879b-aa88f1510139 tempest-ProjectReaderTests-333247446 None] Created volume successfully. Nov 06 14:46:20 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236 Nov 06 14:46:20 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:20 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74ff08f4-0c40-4ec4-ab3b-b63f7ae8a3a0 tempest-VolumeDependencyTests-2108232285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4" returned: 0 in 0.287s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-74ff08f4-0c40-4ec4-ab3b-b63f7ae8a3a0 tempest-VolumeDependencyTests-2108232285 None] Lock "cinder-quobyte-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4" released by "delete_volume" :: held 0.906s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:20 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-74ff08f4-0c40-4ec4-ab3b-b63f7ae8a3a0 tempest-VolumeDependencyTests-2108232285 None] Created reservations ['6c36d488-5ea3-460a-855a-b0da9f173cbd', '6e7608aa-3407-4089-8ad2-6bec44dd3105', '51fcc710-2d41-4662-99b2-adf1808e88fe', '934fd5b0-8b7d-4855-a418-2b278e8047c5'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:20 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-acce7d8a-655a-4143-8533-1511fa51cf47 tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236" returned: 0 in 0.440s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-acce7d8a-655a-4143-8533-1511fa51cf47 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236.bc276cc0-bbc2-4924-b604-74ecf9768fe0 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:20 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236.bc276cc0-bbc2-4924-b604-74ecf9768fe0 Nov 06 14:46:20 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-74ff08f4-0c40-4ec4-ab3b-b63f7ae8a3a0 tempest-VolumeDependencyTests-2108232285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-74ff08f4-0c40-4ec4-ab3b-b63f7ae8a3a0 tempest-VolumeDependencyTests-2108232285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-74ff08f4-0c40-4ec4-ab3b-b63f7ae8a3a0 tempest-VolumeDependencyTests-2108232285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-74ff08f4-0c40-4ec4-ab3b-b63f7ae8a3a0 tempest-VolumeDependencyTests-2108232285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-74ff08f4-0c40-4ec4-ab3b-b63f7ae8a3a0 tempest-VolumeDependencyTests-2108232285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74ff08f4-0c40-4ec4-ab3b-b63f7ae8a3a0 tempest-VolumeDependencyTests-2108232285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:20 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:46:20 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:21 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-74ff08f4-0c40-4ec4-ab3b-b63f7ae8a3a0 tempest-VolumeDependencyTests-2108232285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.353s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:21 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-74ff08f4-0c40-4ec4-ab3b-b63f7ae8a3a0 tempest-VolumeDependencyTests-2108232285 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:46:21 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-74ff08f4-0c40-4ec4-ab3b-b63f7ae8a3a0 tempest-VolumeDependencyTests-2108232285 None] Deleted volume successfully. Nov 06 14:46:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-74ff08f4-0c40-4ec4-ab3b-b63f7ae8a3a0 tempest-VolumeDependencyTests-2108232285 None] Lock "cinder-4ee7c09f-1b32-4069-8b7b-2e4e20dec8f4-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:21 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-acce7d8a-655a-4143-8533-1511fa51cf47 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236.bc276cc0-bbc2-4924-b604-74ecf9768fe0" returned: 0 in 0.564s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-acce7d8a-655a-4143-8533-1511fa51cf47 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236.bc276cc0-bbc2-4924-b604-74ecf9768fe0 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:21 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236.bc276cc0-bbc2-4924-b604-74ecf9768fe0 Nov 06 14:46:21 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-97c23185-9dc5-49d8-92bf-a866dd548a84 tempest-ProjectReaderTests-333247446 None] Acquiring lock "cinder-48d8b120-bd96-4fb1-a4d0-fd470f2ddd6e-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-97c23185-9dc5-49d8-92bf-a866dd548a84 tempest-ProjectReaderTests-333247446 None] Lock "cinder-48d8b120-bd96-4fb1-a4d0-fd470f2ddd6e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-97c23185-9dc5-49d8-92bf-a866dd548a84 tempest-ProjectReaderTests-333247446 None] Acquiring lock "cinder-quobyte-48d8b120-bd96-4fb1-a4d0-fd470f2ddd6e" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-97c23185-9dc5-49d8-92bf-a866dd548a84 tempest-ProjectReaderTests-333247446 None] Lock "cinder-quobyte-48d8b120-bd96-4fb1-a4d0-fd470f2ddd6e" acquired by "delete_volume" :: waited 0.028s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:21 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[c204a698-11aa-497d-9192-eae801dfeceb]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-97c23185-9dc5-49d8-92bf-a866dd548a84 tempest-ProjectReaderTests-333247446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48d8b120-bd96-4fb1-a4d0-fd470f2ddd6e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:21 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-acce7d8a-655a-4143-8533-1511fa51cf47 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236.bc276cc0-bbc2-4924-b604-74ecf9768fe0" returned: 0 in 0.421s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:21 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48d8b120-bd96-4fb1-a4d0-fd470f2ddd6e Nov 06 14:46:21 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-acce7d8a-655a-4143-8533-1511fa51cf47 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-bc276cc0-bbc2-4924-b604-74ecf9768fe0" released by "_delete_snapshot" :: held 2.295s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-acce7d8a-655a-4143-8533-1511fa51cf47 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-e21deba7-ac58-4527-99e7-2943ae57d236" released by "delete_snapshot" :: held 2.327s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:22 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-acce7d8a-655a-4143-8533-1511fa51cf47 tempest-ProjectMemberTests-1693853425 None] Created reservations ['72b9daae-0bf4-4a69-93b3-0ce749675f8a', '338236f6-67de-4f57-99e8-112c3370e2a3', '2f1bff53-9084-4fca-bb38-0ac16ce6a97f', '84205f5d-9bb0-4c21-a4e7-d76f7b4fa6ef'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:22 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-acce7d8a-655a-4143-8533-1511fa51cf47 tempest-ProjectMemberTests-1693853425 None] Delete snapshot completed successfully. Nov 06 14:46:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-acce7d8a-655a-4143-8533-1511fa51cf47 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-bc276cc0-bbc2-4924-b604-74ecf9768fe0-delete_snapshot" released by "delete_snapshot" :: held 2.559s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:22 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-97c23185-9dc5-49d8-92bf-a866dd548a84 tempest-ProjectReaderTests-333247446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48d8b120-bd96-4fb1-a4d0-fd470f2ddd6e" returned: 0 in 0.544s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-97c23185-9dc5-49d8-92bf-a866dd548a84 tempest-ProjectReaderTests-333247446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48d8b120-bd96-4fb1-a4d0-fd470f2ddd6e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:22 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48d8b120-bd96-4fb1-a4d0-fd470f2ddd6e Nov 06 14:46:22 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:22 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-97c23185-9dc5-49d8-92bf-a866dd548a84 tempest-ProjectReaderTests-333247446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48d8b120-bd96-4fb1-a4d0-fd470f2ddd6e" returned: 0 in 0.300s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-97c23185-9dc5-49d8-92bf-a866dd548a84 tempest-ProjectReaderTests-333247446 None] Lock "cinder-quobyte-48d8b120-bd96-4fb1-a4d0-fd470f2ddd6e" released by "delete_volume" :: held 0.906s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:22 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-97c23185-9dc5-49d8-92bf-a866dd548a84 tempest-ProjectReaderTests-333247446 None] Created reservations ['5d11fea7-be73-4b33-ba53-5fda43657607', '0d24f9a1-1d9e-48d1-8044-753dbcc61c99', '771385a0-6b85-46e5-9688-b839ce1f3755', '28121599-e047-4f94-8174-161f762a8d64'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-97c23185-9dc5-49d8-92bf-a866dd548a84 tempest-ProjectReaderTests-333247446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-97c23185-9dc5-49d8-92bf-a866dd548a84 tempest-ProjectReaderTests-333247446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:22 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-97c23185-9dc5-49d8-92bf-a866dd548a84 tempest-ProjectReaderTests-333247446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:22 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-97c23185-9dc5-49d8-92bf-a866dd548a84 tempest-ProjectReaderTests-333247446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-97c23185-9dc5-49d8-92bf-a866dd548a84 tempest-ProjectReaderTests-333247446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-97c23185-9dc5-49d8-92bf-a866dd548a84 tempest-ProjectReaderTests-333247446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:22 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:46:22 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b6a11f9a-d4aa-42c3-8941-b9bcffc24552 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-e21deba7-ac58-4527-99e7-2943ae57d236-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b6a11f9a-d4aa-42c3-8941-b9bcffc24552 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-e21deba7-ac58-4527-99e7-2943ae57d236-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b6a11f9a-d4aa-42c3-8941-b9bcffc24552 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-quobyte-e21deba7-ac58-4527-99e7-2943ae57d236" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b6a11f9a-d4aa-42c3-8941-b9bcffc24552 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-e21deba7-ac58-4527-99e7-2943ae57d236" acquired by "delete_volume" :: waited 0.025s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:23 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9e2035-c0f4-416c-ba50-b46da2e8991e]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b6a11f9a-d4aa-42c3-8941-b9bcffc24552 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:23 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-97c23185-9dc5-49d8-92bf-a866dd548a84 tempest-ProjectReaderTests-333247446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.372s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:23 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-97c23185-9dc5-49d8-92bf-a866dd548a84 tempest-ProjectReaderTests-333247446 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:46:23 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-97c23185-9dc5-49d8-92bf-a866dd548a84 tempest-ProjectReaderTests-333247446 None] Deleted volume successfully. Nov 06 14:46:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-97c23185-9dc5-49d8-92bf-a866dd548a84 tempest-ProjectReaderTests-333247446 None] Lock "cinder-48d8b120-bd96-4fb1-a4d0-fd470f2ddd6e-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:46:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:23 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:46:23 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:23 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236 Nov 06 14:46:23 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:23 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.317s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:23 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:46:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager._thread_info {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:46:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread count: 28 {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 14:46:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread info: [<_MainThread(MainThread, started 130306900594816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 14:46:23 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b6a11f9a-d4aa-42c3-8941-b9bcffc24552 tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236" returned: 0 in 0.429s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b6a11f9a-d4aa-42c3-8941-b9bcffc24552 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:23 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236 Nov 06 14:46:23 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:23 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b6a11f9a-d4aa-42c3-8941-b9bcffc24552 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e21deba7-ac58-4527-99e7-2943ae57d236" returned: 0 in 0.293s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b6a11f9a-d4aa-42c3-8941-b9bcffc24552 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-e21deba7-ac58-4527-99e7-2943ae57d236" released by "delete_volume" :: held 0.825s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:23 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-b6a11f9a-d4aa-42c3-8941-b9bcffc24552 tempest-ProjectMemberTests-1693853425 None] Created reservations ['65fb11be-c0f3-47f2-9125-b2e1c863c82c', '2681c958-201a-45a4-a2ff-8d3d498d6a09', '6baa942e-8b6f-47d5-9c9f-61d5d07d161e', 'e662857c-7008-44f8-9768-08543a10d23d'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b6a11f9a-d4aa-42c3-8941-b9bcffc24552 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b6a11f9a-d4aa-42c3-8941-b9bcffc24552 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b6a11f9a-d4aa-42c3-8941-b9bcffc24552 tempest-ProjectMemberTests-1693853425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b6a11f9a-d4aa-42c3-8941-b9bcffc24552 tempest-ProjectMemberTests-1693853425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b6a11f9a-d4aa-42c3-8941-b9bcffc24552 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b6a11f9a-d4aa-42c3-8941-b9bcffc24552 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:24 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:46:24 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Flow 'volume_create_manager' (2c63ce7c-9cc1-4c9a-94f6-c7aead999265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bba65645-d23c-45ad-948d-ad271f4b5d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:24 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bba65645-d23c-45ad-948d-ad271f4b5d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1348989413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e651964f-6340-406b-9ad6-1cdb1f547b5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85121a10e6f743e68c588daf22e28fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:24Z,use_quota=True,user_id='7d7bb92b56bb4dbbade045d50e1ee40d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6101337c-5256-4200-8344-2dae34ed55db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6101337c-5256-4200-8344-2dae34ed55db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3540c81-b740-413a-9a19-3ee18f9ac5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3540c81-b740-413a-9a19-3ee18f9ac5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e651964f-6340-406b-9ad6-1cdb1f547b5e', 'volume_name': 'volume-e651964f-6340-406b-9ad6-1cdb1f547b5e', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9bfa449-052e-4b69-b460-e52411cfc0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9bfa449-052e-4b69-b460-e52411cfc0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6e9c8d-1716-4a41-a0e7-e4b084c761c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:24 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Volume e651964f-6340-406b-9ad6-1cdb1f547b5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e651964f-6340-406b-9ad6-1cdb1f547b5e', 'volume_size': 1} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1348989413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e651964f-6340-406b-9ad6-1cdb1f547b5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85121a10e6f743e68c588daf22e28fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:24Z,use_quota=True,user_id='7d7bb92b56bb4dbbade045d50e1ee40d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Creating volume e651964f-6340-406b-9ad6-1cdb1f547b5e {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:46:24 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e651964f-6340-406b-9ad6-1cdb1f547b5e 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b6a11f9a-d4aa-42c3-8941-b9bcffc24552 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.501s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-b6a11f9a-d4aa-42c3-8941-b9bcffc24552 tempest-ProjectMemberTests-1693853425 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:46:24 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-b6a11f9a-d4aa-42c3-8941-b9bcffc24552 tempest-ProjectMemberTests-1693853425 None] Deleted volume successfully. Nov 06 14:46:24 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e651964f-6340-406b-9ad6-1cdb1f547b5e 1073741824 Nov 06 14:46:24 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b6a11f9a-d4aa-42c3-8941-b9bcffc24552 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-e21deba7-ac58-4527-99e7-2943ae57d236-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Flow 'volume_create_manager' (3aff2b3c-5360-4b1c-8def-28fbbb1ebab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c73f2318-4bf5-41bd-bc95-594abdf2d48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c73f2318-4bf5-41bd-bc95-594abdf2d48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1714546466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf72c54a-a5a5-45b6-9816-e09dd907e266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='babad70bf4064f0c988ad5aee77822ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:25Z,use_quota=True,user_id='874776ea9ab343e5a2850727553c4735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea06ae9-e68c-43a0-bbe0-309caf3c0084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea06ae9-e68c-43a0-bbe0-309caf3c0084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7570d0-6753-4df5-ad0f-809548ada9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7570d0-6753-4df5-ad0f-809548ada9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf72c54a-a5a5-45b6-9816-e09dd907e266', 'volume_name': 'volume-cf72c54a-a5a5-45b6-9816-e09dd907e266', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2dbd01d-6b05-4ebc-810b-a648d078bead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2dbd01d-6b05-4ebc-810b-a648d078bead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d60c42-6b08-4b8c-acc8-c31965abec07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:24 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Volume cf72c54a-a5a5-45b6-9816-e09dd907e266: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf72c54a-a5a5-45b6-9816-e09dd907e266', 'volume_size': 1} Nov 06 14:46:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:25 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e651964f-6340-406b-9ad6-1cdb1f547b5e 1073741824" returned: 0 in 0.618s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e651964f-6340-406b-9ad6-1cdb1f547b5e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:25 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e651964f-6340-406b-9ad6-1cdb1f547b5e Nov 06 14:46:25 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:25 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e651964f-6340-406b-9ad6-1cdb1f547b5e" returned: 0 in 0.298s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:46:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.530s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1714546466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf72c54a-a5a5-45b6-9816-e09dd907e266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='babad70bf4064f0c988ad5aee77822ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:25Z,use_quota=True,user_id='874776ea9ab343e5a2850727553c4735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:46:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Creating volume cf72c54a-a5a5-45b6-9816-e09dd907e266 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:46:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:46:25 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:46:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:25 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266 1073741824 Nov 06 14:46:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6e9c8d-1716-4a41-a0e7-e4b084c761c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e651964f-6340-406b-9ad6-1cdb1f547b5e', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:25 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b80b5e2-7043-4baf-ad33-bf99109e6e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:25 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Volume volume-e651964f-6340-406b-9ad6-1cdb1f547b5e (e651964f-6340-406b-9ad6-1cdb1f547b5e): created successfully Nov 06 14:46:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b80b5e2-7043-4baf-ad33-bf99109e6e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Flow 'volume_create_manager' (2c63ce7c-9cc1-4c9a-94f6-c7aead999265) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:25 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-879e8a37-a21f-4750-b2ce-9a73c4a5c687 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Created volume successfully. Nov 06 14:46:26 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266 1073741824" returned: 0 in 0.565s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:26 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266 Nov 06 14:46:26 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:26 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266" returned: 0 in 0.257s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:26 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:46:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d60c42-6b08-4b8c-acc8-c31965abec07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf72c54a-a5a5-45b6-9816-e09dd907e266', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80841ae4-af02-4cae-8b19-82ab055e1449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:26 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Volume volume-cf72c54a-a5a5-45b6-9816-e09dd907e266 (cf72c54a-a5a5-45b6-9816-e09dd907e266): created successfully Nov 06 14:46:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80841ae4-af02-4cae-8b19-82ab055e1449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:26 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Flow 'volume_create_manager' (3aff2b3c-5360-4b1c-8def-28fbbb1ebab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:26 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-56c0c7c7-9b42-438e-8e33-84ec4e79d1de tempest-ProjectMemberTests-1693853425 None] Created volume successfully. Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Flow 'volume_create_manager' (baf4b803-f717-43db-b20c-2ef34355abb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2fb74a-0e00-4ce0-9886-2c286c78c0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2fb74a-0e00-4ce0-9886-2c286c78c0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-823713751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b7eacc-ac59-40b3-9765-7fe314bc9b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85121a10e6f743e68c588daf22e28fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:27Z,use_quota=True,user_id='7d7bb92b56bb4dbbade045d50e1ee40d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c68ba1d-d6c3-4b8e-8a14-7e44ca24ed6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c68ba1d-d6c3-4b8e-8a14-7e44ca24ed6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d758302-1d75-4f24-b1d3-dacab09d5c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d758302-1d75-4f24-b1d3-dacab09d5c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31b7eacc-ac59-40b3-9765-7fe314bc9b13', 'volume_name': 'volume-31b7eacc-ac59-40b3-9765-7fe314bc9b13', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e27128f-e1e6-451a-930e-5a49daa1afe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e27128f-e1e6-451a-930e-5a49daa1afe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a68892f-f097-405e-9e92-19074d08ee05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:27 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Volume 31b7eacc-ac59-40b3-9765-7fe314bc9b13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31b7eacc-ac59-40b3-9765-7fe314bc9b13', 'volume_size': 1} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-823713751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b7eacc-ac59-40b3-9765-7fe314bc9b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85121a10e6f743e68c588daf22e28fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:27Z,use_quota=True,user_id='7d7bb92b56bb4dbbade045d50e1ee40d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Creating volume 31b7eacc-ac59-40b3-9765-7fe314bc9b13 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:46:27 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-31b7eacc-ac59-40b3-9765-7fe314bc9b13 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:27 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-31b7eacc-ac59-40b3-9765-7fe314bc9b13 1073741824 Nov 06 14:46:27 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e36678f9-731f-4acd-a164-64cf7ff010f0 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Flow 'volume_create_manager' (345cf56d-65b9-45da-bdd0-1aaac8627b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31b2cc47-96ce-484d-a8de-83f004cb5fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31b2cc47-96ce-484d-a8de-83f004cb5fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-648599783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f47a0ae-4242-4e1c-ba44-be0cbd714739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85121a10e6f743e68c588daf22e28fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:27Z,use_quota=True,user_id='7d7bb92b56bb4dbbade045d50e1ee40d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c04caf5a-8f04-46e4-a4fa-37ab25c3b859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c04caf5a-8f04-46e4-a4fa-37ab25c3b859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f5a14e-aaab-4c14-8b3d-cf6ff2507376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f5a14e-aaab-4c14-8b3d-cf6ff2507376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f47a0ae-4242-4e1c-ba44-be0cbd714739', 'volume_name': 'volume-3f47a0ae-4242-4e1c-ba44-be0cbd714739', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (551e4f18-9cac-4d28-9e33-1c04af6a5418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (551e4f18-9cac-4d28-9e33-1c04af6a5418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b5d5b11-b31c-4573-a74a-1252b7e32539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:27 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Volume 3f47a0ae-4242-4e1c-ba44-be0cbd714739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f47a0ae-4242-4e1c-ba44-be0cbd714739', 'volume_size': 1} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:27 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-31b7eacc-ac59-40b3-9765-7fe314bc9b13 1073741824" returned: 0 in 0.640s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-31b7eacc-ac59-40b3-9765-7fe314bc9b13 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:27 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-31b7eacc-ac59-40b3-9765-7fe314bc9b13 Nov 06 14:46:27 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:46:28 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Flow 'volume_create_manager' (db229e23-3e05-4f63-b3e4-b749b25489bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b39d874-a91f-45b9-b548-bc832412d527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-31b7eacc-ac59-40b3-9765-7fe314bc9b13" returned: 0 in 0.384s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e36678f9-731f-4acd-a164-64cf7ff010f0 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.046s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b39d874-a91f-45b9-b548-bc832412d527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-111567807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f40c363-db29-4fd5-929d-ab01121f9985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1f977161a04a70864580ac4036ed52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:28Z,use_quota=True,user_id='c87e9ba9f2e24a5a993dc5a5d5484409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9b6ffba-dfaf-4e89-ba2e-c4fd25a71771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9b6ffba-dfaf-4e89-ba2e-c4fd25a71771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112966e1-3353-4edd-989e-2220f841b4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112966e1-3353-4edd-989e-2220f841b4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f40c363-db29-4fd5-929d-ab01121f9985', 'volume_name': 'volume-5f40c363-db29-4fd5-929d-ab01121f9985', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459bf19c-2817-4ff7-a747-7548485a3563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459bf19c-2817-4ff7-a747-7548485a3563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659a1956-7d49-4936-9db0-d729deb41652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:28 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Volume 5f40c363-db29-4fd5-929d-ab01121f9985: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f40c363-db29-4fd5-929d-ab01121f9985', 'volume_size': 1} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a68892f-f097-405e-9e92-19074d08ee05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31b7eacc-ac59-40b3-9765-7fe314bc9b13', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1fce1c-0aa1-42df-8457-0981f0f42730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Flow 'volume_create_manager' (c1eee2af-28ae-4076-8ea6-5a225a29c067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c636fa28-fef6-4c25-bb4b-f8b4892ff9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:28 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Volume volume-31b7eacc-ac59-40b3-9765-7fe314bc9b13 (31b7eacc-ac59-40b3-9765-7fe314bc9b13): created successfully Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1fce1c-0aa1-42df-8457-0981f0f42730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Flow 'volume_create_manager' (baf4b803-f717-43db-b20c-2ef34355abb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-e36678f9-731f-4acd-a164-64cf7ff010f0 tempest-ProjectMemberTests-1693853425 None] Creating offline snapshot f5ed05f6-330a-452a-b945-0778b0ab91c9 of volume cf72c54a-a5a5-45b6-9816-e09dd907e266 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c636fa28-fef6-4c25-bb4b-f8b4892ff9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1171020345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7dce830-5ef2-40e5-8cef-952e610f00d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85121a10e6f743e68c588daf22e28fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:28Z,use_quota=True,user_id='7d7bb92b56bb4dbbade045d50e1ee40d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d4de9b5-b357-4b89-af40-cb159066c258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d4de9b5-b357-4b89-af40-cb159066c258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ed7382-60c1-4b59-baf6-242a4adcdf4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ed7382-60c1-4b59-baf6-242a4adcdf4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7dce830-5ef2-40e5-8cef-952e610f00d0', 'volume_name': 'volume-a7dce830-5ef2-40e5-8cef-952e610f00d0', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf3d59e-a2c4-4d80-be18-5b3accaa30ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf3d59e-a2c4-4d80-be18-5b3accaa30ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d970ed6-6e0c-4198-bc6c-5a3d6f683f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:28 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Volume a7dce830-5ef2-40e5-8cef-952e610f00d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7dce830-5ef2-40e5-8cef-952e610f00d0', 'volume_size': 1} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b05d83a-e38f-406f-a28f-113f0ffc381a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e36678f9-731f-4acd-a164-64cf7ff010f0 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:28 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-714ebabd-5393-47d4-9797-bec5d898998a tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Created volume successfully. Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Flow 'volume_create_manager' (d27d5324-f9e5-40c1-861b-9c628928954e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15befb7a-8e8b-46b4-adf0-49e3882fb9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15befb7a-8e8b-46b4-adf0-49e3882fb9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-98953579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38abdfe8-fd41-4338-a834-5e229d61bd04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85121a10e6f743e68c588daf22e28fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:28Z,use_quota=True,user_id='7d7bb92b56bb4dbbade045d50e1ee40d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c646725d-ebde-4c5f-a864-0d72a94a39f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:28 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266 Nov 06 14:46:28 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c646725d-ebde-4c5f-a864-0d72a94a39f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b0e70a-785c-433c-8c77-b5d76e1b23b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b0e70a-785c-433c-8c77-b5d76e1b23b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38abdfe8-fd41-4338-a834-5e229d61bd04', 'volume_name': 'volume-38abdfe8-fd41-4338-a834-5e229d61bd04', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (502573ae-c587-4356-8d35-2aeb7aaa30b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (502573ae-c587-4356-8d35-2aeb7aaa30b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c2eab0-7ad6-4299-ad81-b51b0d960214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:28 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Volume 38abdfe8-fd41-4338-a834-5e229d61bd04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38abdfe8-fd41-4338-a834-5e229d61bd04', 'volume_size': 1} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:28 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e36678f9-731f-4acd-a164-64cf7ff010f0 tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266" returned: 0 in 0.454s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e36678f9-731f-4acd-a164-64cf7ff010f0 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266.f5ed05f6-330a-452a-b945-0778b0ab91c9 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:28 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266.f5ed05f6-330a-452a-b945-0778b0ab91c9 1G Nov 06 14:46:28 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:29 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:46:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Flow 'volume_create_manager' (6ea7ca53-ce33-449c-ae50-1c75204c4167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2adcff6a-6eba-4c68-a4fa-4aac516625eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2adcff6a-6eba-4c68-a4fa-4aac516625eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1037890991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ba25559-0687-4160-b34f-c1d72b48a2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85121a10e6f743e68c588daf22e28fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:29Z,use_quota=True,user_id='7d7bb92b56bb4dbbade045d50e1ee40d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0874c1ca-188b-4c5d-9ac0-aaa78d67ac96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0874c1ca-188b-4c5d-9ac0-aaa78d67ac96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c29075-9da2-4909-990c-91b1ba469cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c29075-9da2-4909-990c-91b1ba469cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ba25559-0687-4160-b34f-c1d72b48a2c3', 'volume_name': 'volume-3ba25559-0687-4160-b34f-c1d72b48a2c3', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a3bf6e9-d3e3-4f6c-9bdc-381f41135a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a3bf6e9-d3e3-4f6c-9bdc-381f41135a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad597daf-99f1-4dd1-ba4c-51295269587c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:29 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Volume 3ba25559-0687-4160-b34f-c1d72b48a2c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ba25559-0687-4160-b34f-c1d72b48a2c3', 'volume_size': 1} Nov 06 14:46:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:29 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e36678f9-731f-4acd-a164-64cf7ff010f0 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266.f5ed05f6-330a-452a-b945-0778b0ab91c9 1G" returned: 0 in 0.391s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e36678f9-731f-4acd-a164-64cf7ff010f0 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf72c54a-a5a5-45b6-9816-e09dd907e266 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266.f5ed05f6-330a-452a-b945-0778b0ab91c9 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:29 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf72c54a-a5a5-45b6-9816-e09dd907e266 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266.f5ed05f6-330a-452a-b945-0778b0ab91c9 Nov 06 14:46:29 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:29 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e36678f9-731f-4acd-a164-64cf7ff010f0 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf72c54a-a5a5-45b6-9816-e09dd907e266 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266.f5ed05f6-330a-452a-b945-0778b0ab91c9" returned: 0 in 0.277s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:29 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-e36678f9-731f-4acd-a164-64cf7ff010f0 tempest-ProjectMemberTests-1693853425 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266.f5ed05f6-330a-452a-b945-0778b0ab91c9 is being set with open permissions: ugo+rw Nov 06 14:46:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e36678f9-731f-4acd-a164-64cf7ff010f0 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266.f5ed05f6-330a-452a-b945-0778b0ab91c9 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:29 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266.f5ed05f6-330a-452a-b945-0778b0ab91c9 Nov 06 14:46:29 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:29 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e36678f9-731f-4acd-a164-64cf7ff010f0 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266.f5ed05f6-330a-452a-b945-0778b0ab91c9" returned: 0 in 0.261s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e36678f9-731f-4acd-a164-64cf7ff010f0 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:29 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266.info Nov 06 14:46:29 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:30 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e36678f9-731f-4acd-a164-64cf7ff010f0 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266.info" returned: 0 in 0.275s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:30 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-e36678f9-731f-4acd-a164-64cf7ff010f0 tempest-ProjectMemberTests-1693853425 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266.info is being set with open permissions: ugo+rw Nov 06 14:46:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e36678f9-731f-4acd-a164-64cf7ff010f0 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:30 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266.info Nov 06 14:46:30 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:30 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e36678f9-731f-4acd-a164-64cf7ff010f0 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266.info" returned: 0 in 0.264s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e36678f9-731f-4acd-a164-64cf7ff010f0 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.250s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.919s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:30 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-648599783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f47a0ae-4242-4e1c-ba44-be0cbd714739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85121a10e6f743e68c588daf22e28fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:27Z,use_quota=True,user_id='7d7bb92b56bb4dbbade045d50e1ee40d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:46:30 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Creating volume 3f47a0ae-4242-4e1c-ba44-be0cbd714739 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:46:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:30 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:30 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:30 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:46:30 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:46:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3f47a0ae-4242-4e1c-ba44-be0cbd714739 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:30 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3f47a0ae-4242-4e1c-ba44-be0cbd714739 1073741824 Nov 06 14:46:30 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:30 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-e36678f9-731f-4acd-a164-64cf7ff010f0 tempest-ProjectMemberTests-1693853425 None] Create snapshot completed successfully Nov 06 14:46:30 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3f47a0ae-4242-4e1c-ba44-be0cbd714739 1073741824" returned: 0 in 0.452s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3f47a0ae-4242-4e1c-ba44-be0cbd714739 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:31 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3f47a0ae-4242-4e1c-ba44-be0cbd714739 Nov 06 14:46:31 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:31 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3f47a0ae-4242-4e1c-ba44-be0cbd714739" returned: 0 in 0.271s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.925s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-111567807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f40c363-db29-4fd5-929d-ab01121f9985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1f977161a04a70864580ac4036ed52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:28Z,use_quota=True,user_id='c87e9ba9f2e24a5a993dc5a5d5484409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Creating volume 5f40c363-db29-4fd5-929d-ab01121f9985 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:46:31 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5f40c363-db29-4fd5-929d-ab01121f9985 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b5d5b11-b31c-4573-a74a-1252b7e32539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f47a0ae-4242-4e1c-ba44-be0cbd714739', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4621b80-a3be-46db-b00d-9c5151262971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:31 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5f40c363-db29-4fd5-929d-ab01121f9985 1073741824 Nov 06 14:46:31 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:31 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Volume volume-3f47a0ae-4242-4e1c-ba44-be0cbd714739 (3f47a0ae-4242-4e1c-ba44-be0cbd714739): created successfully Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4621b80-a3be-46db-b00d-9c5151262971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Flow 'volume_create_manager' (345cf56d-65b9-45da-bdd0-1aaac8627b26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:31 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-dbda4433-7b33-4835-a611-7f551a5c1f0e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Created volume successfully. Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:UPDATE=264,cinder:SELECT=196,cinder:INSERT=79,cinder:DELETE=27 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-75d16916-a9c0-424e-8469-a950c9bdad39 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-f5ed05f6-330a-452a-b945-0778b0ab91c9-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-75d16916-a9c0-424e-8469-a950c9bdad39 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-f5ed05f6-330a-452a-b945-0778b0ab91c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-75d16916-a9c0-424e-8469-a950c9bdad39 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-quobyte-cf72c54a-a5a5-45b6-9816-e09dd907e266" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-75d16916-a9c0-424e-8469-a950c9bdad39 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-cf72c54a-a5a5-45b6-9816-e09dd907e266" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-75d16916-a9c0-424e-8469-a950c9bdad39 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-quobyte-f5ed05f6-330a-452a-b945-0778b0ab91c9" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-75d16916-a9c0-424e-8469-a950c9bdad39 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-f5ed05f6-330a-452a-b945-0778b0ab91c9" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-75d16916-a9c0-424e-8469-a950c9bdad39 tempest-ProjectMemberTests-1693853425 None] Deleting offline snapshot f5ed05f6-330a-452a-b945-0778b0ab91c9 of volume cf72c54a-a5a5-45b6-9816-e09dd907e266 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-75d16916-a9c0-424e-8469-a950c9bdad39 tempest-ProjectMemberTests-1693853425 None] snapshot_file for this snap is: volume-cf72c54a-a5a5-45b6-9816-e09dd907e266.f5ed05f6-330a-452a-b945-0778b0ab91c9 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8ac3a9-745b-42b6-938b-1b95b07fe440]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-75d16916-a9c0-424e-8469-a950c9bdad39 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266.f5ed05f6-330a-452a-b945-0778b0ab91c9 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:31 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266.f5ed05f6-330a-452a-b945-0778b0ab91c9 Nov 06 14:46:31 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:31 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5f40c363-db29-4fd5-929d-ab01121f9985 1073741824" returned: 0 in 0.528s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=212,cinder:UPDATE=269,cinder:DELETE=22,cinder:INSERT=65 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:46:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5f40c363-db29-4fd5-929d-ab01121f9985 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:31 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5f40c363-db29-4fd5-929d-ab01121f9985 Nov 06 14:46:31 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:32 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-75d16916-a9c0-424e-8469-a950c9bdad39 tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266.f5ed05f6-330a-452a-b945-0778b0ab91c9" returned: 0 in 0.476s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-75d16916-a9c0-424e-8469-a950c9bdad39 tempest-ProjectMemberTests-1693853425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf72c54a-a5a5-45b6-9816-e09dd907e266(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fe6ef6-8605-4785-ab7d-b1ee6a657cb7]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-75d16916-a9c0-424e-8469-a950c9bdad39 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:32 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5f40c363-db29-4fd5-929d-ab01121f9985" returned: 0 in 0.324s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.691s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1171020345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7dce830-5ef2-40e5-8cef-952e610f00d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85121a10e6f743e68c588daf22e28fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:28Z,use_quota=True,user_id='7d7bb92b56bb4dbbade045d50e1ee40d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Creating volume a7dce830-5ef2-40e5-8cef-952e610f00d0 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:46:32 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a7dce830-5ef2-40e5-8cef-952e610f00d0 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659a1956-7d49-4936-9db0-d729deb41652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f40c363-db29-4fd5-929d-ab01121f9985', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddef2618-0e3e-4aa6-bd87-69a0a2cdf668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:32 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a7dce830-5ef2-40e5-8cef-952e610f00d0 1073741824 Nov 06 14:46:32 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:32 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Volume volume-5f40c363-db29-4fd5-929d-ab01121f9985 (5f40c363-db29-4fd5-929d-ab01121f9985): created successfully Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddef2618-0e3e-4aa6-bd87-69a0a2cdf668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Flow 'volume_create_manager' (db229e23-3e05-4f63-b3e4-b749b25489bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:32 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-4b443814-3f46-4d64-a85d-2fcec5dd1aff tempest-ProjectReaderTests-946381399 None] Created volume successfully. Nov 06 14:46:32 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266 Nov 06 14:46:32 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:32 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-75d16916-a9c0-424e-8469-a950c9bdad39 tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266" returned: 0 in 0.394s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-75d16916-a9c0-424e-8469-a950c9bdad39 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266.f5ed05f6-330a-452a-b945-0778b0ab91c9 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:32 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266.f5ed05f6-330a-452a-b945-0778b0ab91c9 Nov 06 14:46:32 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:32 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a7dce830-5ef2-40e5-8cef-952e610f00d0 1073741824" returned: 0 in 0.491s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a7dce830-5ef2-40e5-8cef-952e610f00d0 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:32 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a7dce830-5ef2-40e5-8cef-952e610f00d0 Nov 06 14:46:32 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:32 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-75d16916-a9c0-424e-8469-a950c9bdad39 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266.f5ed05f6-330a-452a-b945-0778b0ab91c9" returned: 0 in 0.360s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-75d16916-a9c0-424e-8469-a950c9bdad39 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266.f5ed05f6-330a-452a-b945-0778b0ab91c9 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:32 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266.f5ed05f6-330a-452a-b945-0778b0ab91c9 Nov 06 14:46:32 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:32 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a7dce830-5ef2-40e5-8cef-952e610f00d0" returned: 0 in 0.264s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.308s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-98953579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38abdfe8-fd41-4338-a834-5e229d61bd04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85121a10e6f743e68c588daf22e28fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:28Z,use_quota=True,user_id='7d7bb92b56bb4dbbade045d50e1ee40d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Creating volume 38abdfe8-fd41-4338-a834-5e229d61bd04 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:32 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:46:33 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-38abdfe8-fd41-4338-a834-5e229d61bd04 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d970ed6-6e0c-4198-bc6c-5a3d6f683f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7dce830-5ef2-40e5-8cef-952e610f00d0', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:33 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-38abdfe8-fd41-4338-a834-5e229d61bd04 1073741824 Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36cb07b-412c-44c3-afe9-b82b976276bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:33 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:33 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Volume volume-a7dce830-5ef2-40e5-8cef-952e610f00d0 (a7dce830-5ef2-40e5-8cef-952e610f00d0): created successfully Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36cb07b-412c-44c3-afe9-b82b976276bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Flow 'volume_create_manager' (c1eee2af-28ae-4076-8ea6-5a225a29c067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:33 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-ff3376b3-d05c-4597-989b-b54628908b78 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Created volume successfully. Nov 06 14:46:33 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-75d16916-a9c0-424e-8469-a950c9bdad39 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266.f5ed05f6-330a-452a-b945-0778b0ab91c9" returned: 0 in 0.253s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-75d16916-a9c0-424e-8469-a950c9bdad39 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-f5ed05f6-330a-452a-b945-0778b0ab91c9" released by "_delete_snapshot" :: held 1.662s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-75d16916-a9c0-424e-8469-a950c9bdad39 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-cf72c54a-a5a5-45b6-9816-e09dd907e266" released by "delete_snapshot" :: held 1.698s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-75d16916-a9c0-424e-8469-a950c9bdad39 tempest-ProjectMemberTests-1693853425 None] Created reservations ['d2687d94-52d0-4d4e-86b5-5de97d2b4a68', '96fca4ba-55d7-4502-b720-a0f3c6c02a15', 'ace0fe06-8cad-4ac4-80e9-3b85bc543fe1', 'd854dab6-6093-4fb4-a189-1bbe94f4ea9e'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:33 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-75d16916-a9c0-424e-8469-a950c9bdad39 tempest-ProjectMemberTests-1693853425 None] Delete snapshot completed successfully. Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-75d16916-a9c0-424e-8469-a950c9bdad39 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-f5ed05f6-330a-452a-b945-0778b0ab91c9-delete_snapshot" released by "delete_snapshot" :: held 1.856s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:33 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-38abdfe8-fd41-4338-a834-5e229d61bd04 1073741824" returned: 0 in 0.482s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-38abdfe8-fd41-4338-a834-5e229d61bd04 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:33 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-38abdfe8-fd41-4338-a834-5e229d61bd04 Nov 06 14:46:33 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-231a5d02-2bd0-41b6-bdc5-ab50cf4b2dd7 tempest-ProjectReaderTests-946381399 None] Acquiring lock "cinder-5f40c363-db29-4fd5-929d-ab01121f9985-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-231a5d02-2bd0-41b6-bdc5-ab50cf4b2dd7 tempest-ProjectReaderTests-946381399 None] Lock "cinder-5f40c363-db29-4fd5-929d-ab01121f9985-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-231a5d02-2bd0-41b6-bdc5-ab50cf4b2dd7 tempest-ProjectReaderTests-946381399 None] Acquiring lock "cinder-quobyte-5f40c363-db29-4fd5-929d-ab01121f9985" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-231a5d02-2bd0-41b6-bdc5-ab50cf4b2dd7 tempest-ProjectReaderTests-946381399 None] Lock "cinder-quobyte-5f40c363-db29-4fd5-929d-ab01121f9985" acquired by "delete_volume" :: waited 0.020s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-fc2d1e07-fd7e-4a01-9846-65b4bb74bd7d tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-cf72c54a-a5a5-45b6-9816-e09dd907e266-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[422e45c2-dd2a-49b2-8a87-5b1ff27c1457]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-231a5d02-2bd0-41b6-bdc5-ab50cf4b2dd7 tempest-ProjectReaderTests-946381399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5f40c363-db29-4fd5-929d-ab01121f9985 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-fc2d1e07-fd7e-4a01-9846-65b4bb74bd7d tempest-ProjectMemberTests-1693853425 None] Lock "cinder-cf72c54a-a5a5-45b6-9816-e09dd907e266-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:33 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-38abdfe8-fd41-4338-a834-5e229d61bd04" returned: 0 in 0.305s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.630s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1037890991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ba25559-0687-4160-b34f-c1d72b48a2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85121a10e6f743e68c588daf22e28fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:29Z,use_quota=True,user_id='7d7bb92b56bb4dbbade045d50e1ee40d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Creating volume 3ba25559-0687-4160-b34f-c1d72b48a2c3 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:46:33 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3ba25559-0687-4160-b34f-c1d72b48a2c3 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:33 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3ba25559-0687-4160-b34f-c1d72b48a2c3 1073741824 Nov 06 14:46:33 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c2eab0-7ad6-4299-ad81-b51b0d960214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38abdfe8-fd41-4338-a834-5e229d61bd04', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (615ffa47-1780-4cd0-a3f8-3fdae562ae8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-fc2d1e07-fd7e-4a01-9846-65b4bb74bd7d tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-quobyte-cf72c54a-a5a5-45b6-9816-e09dd907e266" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:33 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Volume volume-38abdfe8-fd41-4338-a834-5e229d61bd04 (38abdfe8-fd41-4338-a834-5e229d61bd04): created successfully Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (615ffa47-1780-4cd0-a3f8-3fdae562ae8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Flow 'volume_create_manager' (d27d5324-f9e5-40c1-861b-9c628928954e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:33 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5f40c363-db29-4fd5-929d-ab01121f9985 Nov 06 14:46:33 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-fc2d1e07-fd7e-4a01-9846-65b4bb74bd7d tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-cf72c54a-a5a5-45b6-9816-e09dd907e266" acquired by "delete_volume" :: waited 0.032s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:33 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-4d0c3bdd-bf46-44c7-9c9f-cd12c2fedae8 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Created volume successfully. Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18b884a-fb36-4ab4-9c65-107e498ec598]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fc2d1e07-fd7e-4a01-9846-65b4bb74bd7d tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:34 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266 Nov 06 14:46:34 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:34 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-231a5d02-2bd0-41b6-bdc5-ab50cf4b2dd7 tempest-ProjectReaderTests-946381399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5f40c363-db29-4fd5-929d-ab01121f9985" returned: 0 in 0.419s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-231a5d02-2bd0-41b6-bdc5-ab50cf4b2dd7 tempest-ProjectReaderTests-946381399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5f40c363-db29-4fd5-929d-ab01121f9985 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:34 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5f40c363-db29-4fd5-929d-ab01121f9985 Nov 06 14:46:34 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:34 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3ba25559-0687-4160-b34f-c1d72b48a2c3 1073741824" returned: 0 in 0.456s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3ba25559-0687-4160-b34f-c1d72b48a2c3 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:34 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3ba25559-0687-4160-b34f-c1d72b48a2c3 Nov 06 14:46:34 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:34 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fc2d1e07-fd7e-4a01-9846-65b4bb74bd7d tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266" returned: 0 in 0.427s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fc2d1e07-fd7e-4a01-9846-65b4bb74bd7d tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:34 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266 Nov 06 14:46:34 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:34 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-231a5d02-2bd0-41b6-bdc5-ab50cf4b2dd7 tempest-ProjectReaderTests-946381399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5f40c363-db29-4fd5-929d-ab01121f9985" returned: 0 in 0.288s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-231a5d02-2bd0-41b6-bdc5-ab50cf4b2dd7 tempest-ProjectReaderTests-946381399 None] Lock "cinder-quobyte-5f40c363-db29-4fd5-929d-ab01121f9985" released by "delete_volume" :: held 0.767s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-231a5d02-2bd0-41b6-bdc5-ab50cf4b2dd7 tempest-ProjectReaderTests-946381399 None] Created reservations ['a1c87fe7-420e-4ba1-83d9-7f263e3e1d78', '08ae1053-193e-4538-b79a-17547c8dd77b', '8d263729-9547-4cc8-85c8-36f98a3e910d', '2cdf242e-51ec-46e8-befc-66432ab8e7bc'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-231a5d02-2bd0-41b6-bdc5-ab50cf4b2dd7 tempest-ProjectReaderTests-946381399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-231a5d02-2bd0-41b6-bdc5-ab50cf4b2dd7 tempest-ProjectReaderTests-946381399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-231a5d02-2bd0-41b6-bdc5-ab50cf4b2dd7 tempest-ProjectReaderTests-946381399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:34 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-231a5d02-2bd0-41b6-bdc5-ab50cf4b2dd7 tempest-ProjectReaderTests-946381399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-231a5d02-2bd0-41b6-bdc5-ab50cf4b2dd7 tempest-ProjectReaderTests-946381399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-231a5d02-2bd0-41b6-bdc5-ab50cf4b2dd7 tempest-ProjectReaderTests-946381399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3ba25559-0687-4160-b34f-c1d72b48a2c3" returned: 0 in 0.299s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad597daf-99f1-4dd1-ba4c-51295269587c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ba25559-0687-4160-b34f-c1d72b48a2c3', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:34 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:46:34 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (411676bb-708b-4f85-959e-05be7216b6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:34 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Volume volume-3ba25559-0687-4160-b34f-c1d72b48a2c3 (3ba25559-0687-4160-b34f-c1d72b48a2c3): created successfully Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (411676bb-708b-4f85-959e-05be7216b6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Flow 'volume_create_manager' (6ea7ca53-ce33-449c-ae50-1c75204c4167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:34 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-fd12d296-b818-4b90-8b6a-17cd09e2375e tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Created volume successfully. Nov 06 14:46:34 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fc2d1e07-fd7e-4a01-9846-65b4bb74bd7d tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-cf72c54a-a5a5-45b6-9816-e09dd907e266" returned: 0 in 0.314s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-fc2d1e07-fd7e-4a01-9846-65b4bb74bd7d tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-cf72c54a-a5a5-45b6-9816-e09dd907e266" released by "delete_volume" :: held 0.834s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-fc2d1e07-fd7e-4a01-9846-65b4bb74bd7d tempest-ProjectMemberTests-1693853425 None] Created reservations ['f691e2f2-b84e-455e-9a4c-90b0b0924e4b', '3c492c35-efb0-4744-b398-bebde7e23939', '2b130ca1-17c6-4529-b19a-85f25b8bcf2b', '4c63c1a4-93b1-4828-b681-4998a8155559'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fc2d1e07-fd7e-4a01-9846-65b4bb74bd7d tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fc2d1e07-fd7e-4a01-9846-65b4bb74bd7d tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-fc2d1e07-fd7e-4a01-9846-65b4bb74bd7d tempest-ProjectMemberTests-1693853425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-fc2d1e07-fd7e-4a01-9846-65b4bb74bd7d tempest-ProjectMemberTests-1693853425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-fc2d1e07-fd7e-4a01-9846-65b4bb74bd7d tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fc2d1e07-fd7e-4a01-9846-65b4bb74bd7d tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:34 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:46:34 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:34 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-231a5d02-2bd0-41b6-bdc5-ab50cf4b2dd7 tempest-ProjectReaderTests-946381399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.313s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-231a5d02-2bd0-41b6-bdc5-ab50cf4b2dd7 tempest-ProjectReaderTests-946381399 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:46:34 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-231a5d02-2bd0-41b6-bdc5-ab50cf4b2dd7 tempest-ProjectReaderTests-946381399 None] Deleted volume successfully. Nov 06 14:46:34 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-231a5d02-2bd0-41b6-bdc5-ab50cf4b2dd7 tempest-ProjectReaderTests-946381399 None] Lock "cinder-5f40c363-db29-4fd5-929d-ab01121f9985-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:35 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-fc2d1e07-fd7e-4a01-9846-65b4bb74bd7d tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.347s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-fc2d1e07-fd7e-4a01-9846-65b4bb74bd7d tempest-ProjectMemberTests-1693853425 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:46:35 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-fc2d1e07-fd7e-4a01-9846-65b4bb74bd7d tempest-ProjectMemberTests-1693853425 None] Deleted volume successfully. Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-fc2d1e07-fd7e-4a01-9846-65b4bb74bd7d tempest-ProjectMemberTests-1693853425 None] Lock "cinder-cf72c54a-a5a5-45b6-9816-e09dd907e266-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Flow 'volume_create_manager' (076f59e6-d509-408b-a045-4d248d1707f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e1c52d7-ac4a-42f0-b786-b27aba886ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-594a7b9f-f082-4d53-9a02-7cce9a6a50e6 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "cinder-3ba25559-0687-4160-b34f-c1d72b48a2c3-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e1c52d7-ac4a-42f0-b786-b27aba886ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2013266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94c18e4-7355-41ca-98fe-dafeaa572c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1f977161a04a70864580ac4036ed52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:35Z,use_quota=True,user_id='c87e9ba9f2e24a5a993dc5a5d5484409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e6f7df-e6e2-4213-8856-1028353dca85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e6f7df-e6e2-4213-8856-1028353dca85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc8a978-381b-427a-8c68-bb5f99a327cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc8a978-381b-427a-8c68-bb5f99a327cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b94c18e4-7355-41ca-98fe-dafeaa572c13', 'volume_name': 'volume-b94c18e4-7355-41ca-98fe-dafeaa572c13', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42240b20-1e95-4736-9c08-872b27a1708c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42240b20-1e95-4736-9c08-872b27a1708c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2993824b-8cd6-4f26-bc48-cc17b2346046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:35 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Volume b94c18e4-7355-41ca-98fe-dafeaa572c13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b94c18e4-7355-41ca-98fe-dafeaa572c13', 'volume_size': 1} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2013266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94c18e4-7355-41ca-98fe-dafeaa572c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1f977161a04a70864580ac4036ed52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:35Z,use_quota=True,user_id='c87e9ba9f2e24a5a993dc5a5d5484409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Creating volume b94c18e4-7355-41ca-98fe-dafeaa572c13 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:46:35 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b94c18e4-7355-41ca-98fe-dafeaa572c13 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-594a7b9f-f082-4d53-9a02-7cce9a6a50e6 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "cinder-3ba25559-0687-4160-b34f-c1d72b48a2c3-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:35 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b94c18e4-7355-41ca-98fe-dafeaa572c13 1073741824 Nov 06 14:46:35 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Flow 'volume_create_manager' (f9925d86-7f8e-4a1f-aaf6-069ea38e61df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b5f5e30-ab2b-4fe4-9ed5-d1ef975ef53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b5f5e30-ab2b-4fe4-9ed5-d1ef975ef53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-142111662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ae5e56-b7b7-4b03-b70b-4cb99cc52663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='babad70bf4064f0c988ad5aee77822ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:36Z,use_quota=True,user_id='874776ea9ab343e5a2850727553c4735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ee354a-8104-424e-8e0f-0c69687d3b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ee354a-8104-424e-8e0f-0c69687d3b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (334c1651-db25-4db9-82d0-17f38a276f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (334c1651-db25-4db9-82d0-17f38a276f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3ae5e56-b7b7-4b03-b70b-4cb99cc52663', 'volume_name': 'volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e59ae12-5333-4464-b692-da557a5b2aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e59ae12-5333-4464-b692-da557a5b2aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (574d8eff-5cc5-418b-bc4e-e99d30c7f505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:35 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Volume d3ae5e56-b7b7-4b03-b70b-4cb99cc52663: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663', 'volume_size': 1} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-594a7b9f-f082-4d53-9a02-7cce9a6a50e6 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "cinder-quobyte-3ba25559-0687-4160-b34f-c1d72b48a2c3" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-594a7b9f-f082-4d53-9a02-7cce9a6a50e6 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "cinder-quobyte-3ba25559-0687-4160-b34f-c1d72b48a2c3" acquired by "delete_volume" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bd77fb-0929-414a-b7eb-f9deefb0dc1a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-594a7b9f-f082-4d53-9a02-7cce9a6a50e6 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3ba25559-0687-4160-b34f-c1d72b48a2c3 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:35 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3ba25559-0687-4160-b34f-c1d72b48a2c3 Nov 06 14:46:35 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:36 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b94c18e4-7355-41ca-98fe-dafeaa572c13 1073741824" returned: 0 in 0.450s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b94c18e4-7355-41ca-98fe-dafeaa572c13 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:36 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b94c18e4-7355-41ca-98fe-dafeaa572c13 Nov 06 14:46:36 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:36 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-594a7b9f-f082-4d53-9a02-7cce9a6a50e6 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3ba25559-0687-4160-b34f-c1d72b48a2c3" returned: 0 in 0.404s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-594a7b9f-f082-4d53-9a02-7cce9a6a50e6 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3ba25559-0687-4160-b34f-c1d72b48a2c3 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:36 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3ba25559-0687-4160-b34f-c1d72b48a2c3 Nov 06 14:46:36 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:36 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b94c18e4-7355-41ca-98fe-dafeaa572c13" returned: 0 in 0.264s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.635s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-142111662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ae5e56-b7b7-4b03-b70b-4cb99cc52663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='babad70bf4064f0c988ad5aee77822ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:36Z,use_quota=True,user_id='874776ea9ab343e5a2850727553c4735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Creating volume d3ae5e56-b7b7-4b03-b70b-4cb99cc52663 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:46:36 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2993824b-8cd6-4f26-bc48-cc17b2346046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b94c18e4-7355-41ca-98fe-dafeaa572c13', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:36 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663 1073741824 Nov 06 14:46:36 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa6f878e-d6a2-41f5-8640-f3a978a88d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:36 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Volume volume-b94c18e4-7355-41ca-98fe-dafeaa572c13 (b94c18e4-7355-41ca-98fe-dafeaa572c13): created successfully Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa6f878e-d6a2-41f5-8640-f3a978a88d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Flow 'volume_create_manager' (076f59e6-d509-408b-a045-4d248d1707f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:36 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-48855891-c425-41a8-9b8a-79cddf5cbc0d tempest-ProjectReaderTests-946381399 None] Created volume successfully. Nov 06 14:46:36 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-594a7b9f-f082-4d53-9a02-7cce9a6a50e6 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3ba25559-0687-4160-b34f-c1d72b48a2c3" returned: 0 in 0.281s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-594a7b9f-f082-4d53-9a02-7cce9a6a50e6 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "cinder-quobyte-3ba25559-0687-4160-b34f-c1d72b48a2c3" released by "delete_volume" :: held 0.726s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-594a7b9f-f082-4d53-9a02-7cce9a6a50e6 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Created reservations ['33a4b469-342c-44c6-a56d-b34822e320ca', '0f297c4f-d107-45e5-bb95-a7b2589a951c', '21fd5a71-f2a9-4c03-b813-c766cc217cc2', '4af7e6f5-236c-4f79-9e39-d4fdd73de0d1'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-594a7b9f-f082-4d53-9a02-7cce9a6a50e6 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-594a7b9f-f082-4d53-9a02-7cce9a6a50e6 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-594a7b9f-f082-4d53-9a02-7cce9a6a50e6 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-594a7b9f-f082-4d53-9a02-7cce9a6a50e6 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-594a7b9f-f082-4d53-9a02-7cce9a6a50e6 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-594a7b9f-f082-4d53-9a02-7cce9a6a50e6 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:36 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:46:36 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3af52c94-60a8-446b-ba62-c3839db9a713 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "cinder-38abdfe8-fd41-4338-a834-5e229d61bd04-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3af52c94-60a8-446b-ba62-c3839db9a713 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "cinder-38abdfe8-fd41-4338-a834-5e229d61bd04-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3af52c94-60a8-446b-ba62-c3839db9a713 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "cinder-quobyte-38abdfe8-fd41-4338-a834-5e229d61bd04" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3af52c94-60a8-446b-ba62-c3839db9a713 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "cinder-quobyte-38abdfe8-fd41-4338-a834-5e229d61bd04" acquired by "delete_volume" :: waited 0.019s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc1d1a8-cfff-4a8a-964d-fcba1c96dab3]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3af52c94-60a8-446b-ba62-c3839db9a713 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-38abdfe8-fd41-4338-a834-5e229d61bd04 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:36 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663 1073741824" returned: 0 in 0.520s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:36 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-594a7b9f-f082-4d53-9a02-7cce9a6a50e6 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.302s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-594a7b9f-f082-4d53-9a02-7cce9a6a50e6 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:46:36 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-594a7b9f-f082-4d53-9a02-7cce9a6a50e6 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Deleted volume successfully. Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:36 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-38abdfe8-fd41-4338-a834-5e229d61bd04 Nov 06 14:46:36 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:36 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-594a7b9f-f082-4d53-9a02-7cce9a6a50e6 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "cinder-3ba25559-0687-4160-b34f-c1d72b48a2c3-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:37 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663 Nov 06 14:46:37 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:37 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663" returned: 0 in 0.253s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:37 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3af52c94-60a8-446b-ba62-c3839db9a713 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-38abdfe8-fd41-4338-a834-5e229d61bd04" returned: 0 in 0.374s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3af52c94-60a8-446b-ba62-c3839db9a713 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-38abdfe8-fd41-4338-a834-5e229d61bd04 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (574d8eff-5cc5-418b-bc4e-e99d30c7f505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:37 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-38abdfe8-fd41-4338-a834-5e229d61bd04 Nov 06 14:46:37 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1778a26f-05e4-45e7-af2b-66ee405daa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:37 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Volume volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663 (d3ae5e56-b7b7-4b03-b70b-4cb99cc52663): created successfully Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1778a26f-05e4-45e7-af2b-66ee405daa48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Flow 'volume_create_manager' (f9925d86-7f8e-4a1f-aaf6-069ea38e61df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:37 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-dfaae83a-bc0a-4ad4-a001-4220450dd868 tempest-ProjectMemberTests-1693853425 None] Created volume successfully. Nov 06 14:46:37 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3af52c94-60a8-446b-ba62-c3839db9a713 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-38abdfe8-fd41-4338-a834-5e229d61bd04" returned: 0 in 0.256s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-01f69bd2-5468-4721-a898-fbc9ea942572 tempest-ProjectReaderTests-946381399 None] Acquiring lock "cinder-b94c18e4-7355-41ca-98fe-dafeaa572c13-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3af52c94-60a8-446b-ba62-c3839db9a713 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "cinder-quobyte-38abdfe8-fd41-4338-a834-5e229d61bd04" released by "delete_volume" :: held 0.691s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-01f69bd2-5468-4721-a898-fbc9ea942572 tempest-ProjectReaderTests-946381399 None] Lock "cinder-b94c18e4-7355-41ca-98fe-dafeaa572c13-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-01f69bd2-5468-4721-a898-fbc9ea942572 tempest-ProjectReaderTests-946381399 None] Acquiring lock "cinder-quobyte-b94c18e4-7355-41ca-98fe-dafeaa572c13" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-3af52c94-60a8-446b-ba62-c3839db9a713 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Created reservations ['f7dc199b-8344-4b97-b9fb-eaa5fda0e4ba', '60f0c562-60da-4290-a243-94c53f818764', 'ec9b0e59-7ce7-4e31-93f8-b765fea5ed25', '0437ee72-24c6-446b-8058-1214bd101299'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-01f69bd2-5468-4721-a898-fbc9ea942572 tempest-ProjectReaderTests-946381399 None] Lock "cinder-quobyte-b94c18e4-7355-41ca-98fe-dafeaa572c13" acquired by "delete_volume" :: waited 0.024s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced13ccb-0772-4438-a074-14771332ab8b]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-01f69bd2-5468-4721-a898-fbc9ea942572 tempest-ProjectReaderTests-946381399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b94c18e4-7355-41ca-98fe-dafeaa572c13 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3af52c94-60a8-446b-ba62-c3839db9a713 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3af52c94-60a8-446b-ba62-c3839db9a713 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3af52c94-60a8-446b-ba62-c3839db9a713 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3af52c94-60a8-446b-ba62-c3839db9a713 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3af52c94-60a8-446b-ba62-c3839db9a713 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3af52c94-60a8-446b-ba62-c3839db9a713 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:37 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:46:37 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2c9159d0-53f0-4b2d-86bc-9ab70c2120ef tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2c9159d0-53f0-4b2d-86bc-9ab70c2120ef tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:37 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b94c18e4-7355-41ca-98fe-dafeaa572c13 Nov 06 14:46:37 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-2c9159d0-53f0-4b2d-86bc-9ab70c2120ef tempest-ProjectMemberTests-1693853425 None] Creating offline snapshot f72ba6c1-0e11-40ce-8fc9-a648328841dc of volume d3ae5e56-b7b7-4b03-b70b-4cb99cc52663 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f53abf8-4862-405a-96e8-264e0650bdbd]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2c9159d0-53f0-4b2d-86bc-9ab70c2120ef tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6a069e55-c2db-4886-ad29-423c64353277 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "cinder-a7dce830-5ef2-40e5-8cef-952e610f00d0-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6a069e55-c2db-4886-ad29-423c64353277 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "cinder-a7dce830-5ef2-40e5-8cef-952e610f00d0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6a069e55-c2db-4886-ad29-423c64353277 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "cinder-quobyte-a7dce830-5ef2-40e5-8cef-952e610f00d0" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:38 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3af52c94-60a8-446b-ba62-c3839db9a713 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.280s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-3af52c94-60a8-446b-ba62-c3839db9a713 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:46:38 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663 Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6a069e55-c2db-4886-ad29-423c64353277 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "cinder-quobyte-a7dce830-5ef2-40e5-8cef-952e610f00d0" acquired by "delete_volume" :: waited 0.023s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:38 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:38 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-3af52c94-60a8-446b-ba62-c3839db9a713 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Deleted volume successfully. Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaca2225-cff9-44bc-9e6b-d5478b1d20e8]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6a069e55-c2db-4886-ad29-423c64353277 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a7dce830-5ef2-40e5-8cef-952e610f00d0 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3af52c94-60a8-446b-ba62-c3839db9a713 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "cinder-38abdfe8-fd41-4338-a834-5e229d61bd04-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:38 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-01f69bd2-5468-4721-a898-fbc9ea942572 tempest-ProjectReaderTests-946381399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b94c18e4-7355-41ca-98fe-dafeaa572c13" returned: 0 in 0.486s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-01f69bd2-5468-4721-a898-fbc9ea942572 tempest-ProjectReaderTests-946381399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b94c18e4-7355-41ca-98fe-dafeaa572c13 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:38 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b94c18e4-7355-41ca-98fe-dafeaa572c13 Nov 06 14:46:38 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:38 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a7dce830-5ef2-40e5-8cef-952e610f00d0 Nov 06 14:46:38 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:38 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2c9159d0-53f0-4b2d-86bc-9ab70c2120ef tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663" returned: 0 in 0.469s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2c9159d0-53f0-4b2d-86bc-9ab70c2120ef tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663.f72ba6c1-0e11-40ce-8fc9-a648328841dc 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:38 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663.f72ba6c1-0e11-40ce-8fc9-a648328841dc 1G Nov 06 14:46:38 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:38 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-01f69bd2-5468-4721-a898-fbc9ea942572 tempest-ProjectReaderTests-946381399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-b94c18e4-7355-41ca-98fe-dafeaa572c13" returned: 0 in 0.266s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-01f69bd2-5468-4721-a898-fbc9ea942572 tempest-ProjectReaderTests-946381399 None] Lock "cinder-quobyte-b94c18e4-7355-41ca-98fe-dafeaa572c13" released by "delete_volume" :: held 0.810s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-01f69bd2-5468-4721-a898-fbc9ea942572 tempest-ProjectReaderTests-946381399 None] Created reservations ['0faa8d54-737f-491d-8da2-6900cfe804b1', '1489bba0-250d-49e2-9995-d9b42ea793e5', '0abecebc-5b15-4e79-8a84-bedea614e025', '3b53cb69-23b0-4db7-b425-a3a95419c094'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:38 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6a069e55-c2db-4886-ad29-423c64353277 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a7dce830-5ef2-40e5-8cef-952e610f00d0" returned: 0 in 0.432s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6a069e55-c2db-4886-ad29-423c64353277 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a7dce830-5ef2-40e5-8cef-952e610f00d0 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-01f69bd2-5468-4721-a898-fbc9ea942572 tempest-ProjectReaderTests-946381399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-01f69bd2-5468-4721-a898-fbc9ea942572 tempest-ProjectReaderTests-946381399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-01f69bd2-5468-4721-a898-fbc9ea942572 tempest-ProjectReaderTests-946381399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-01f69bd2-5468-4721-a898-fbc9ea942572 tempest-ProjectReaderTests-946381399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-01f69bd2-5468-4721-a898-fbc9ea942572 tempest-ProjectReaderTests-946381399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-01f69bd2-5468-4721-a898-fbc9ea942572 tempest-ProjectReaderTests-946381399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:38 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a7dce830-5ef2-40e5-8cef-952e610f00d0 Nov 06 14:46:38 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:38 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:46:38 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:38 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6a069e55-c2db-4886-ad29-423c64353277 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-a7dce830-5ef2-40e5-8cef-952e610f00d0" returned: 0 in 0.308s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:38 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2c9159d0-53f0-4b2d-86bc-9ab70c2120ef tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663.f72ba6c1-0e11-40ce-8fc9-a648328841dc 1G" returned: 0 in 0.512s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2c9159d0-53f0-4b2d-86bc-9ab70c2120ef tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663.f72ba6c1-0e11-40ce-8fc9-a648328841dc {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6a069e55-c2db-4886-ad29-423c64353277 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "cinder-quobyte-a7dce830-5ef2-40e5-8cef-952e610f00d0" released by "delete_volume" :: held 0.815s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:38 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663.f72ba6c1-0e11-40ce-8fc9-a648328841dc Nov 06 14:46:38 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:38 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-01f69bd2-5468-4721-a898-fbc9ea942572 tempest-ProjectReaderTests-946381399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.335s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-01f69bd2-5468-4721-a898-fbc9ea942572 tempest-ProjectReaderTests-946381399 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:46:38 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-01f69bd2-5468-4721-a898-fbc9ea942572 tempest-ProjectReaderTests-946381399 None] Deleted volume successfully. Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-01f69bd2-5468-4721-a898-fbc9ea942572 tempest-ProjectReaderTests-946381399 None] Lock "cinder-b94c18e4-7355-41ca-98fe-dafeaa572c13-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:38 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-6a069e55-c2db-4886-ad29-423c64353277 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Created reservations ['07c1f879-f9c4-4f63-b2d7-3f55390324ff', '4975df5f-0930-4165-a2f8-7b7c4aaee3cd', '70b7cf81-d4a0-4a01-bb7c-d1923aff4f00', '798ef512-edee-479c-8f83-463f9a48c11a'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6a069e55-c2db-4886-ad29-423c64353277 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6a069e55-c2db-4886-ad29-423c64353277 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6a069e55-c2db-4886-ad29-423c64353277 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6a069e55-c2db-4886-ad29-423c64353277 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6a069e55-c2db-4886-ad29-423c64353277 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6a069e55-c2db-4886-ad29-423c64353277 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:39 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:46:39 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4f79f379-363e-43a7-820a-54f3e1427212 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "cinder-3f47a0ae-4242-4e1c-ba44-be0cbd714739-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:39 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2c9159d0-53f0-4b2d-86bc-9ab70c2120ef tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663.f72ba6c1-0e11-40ce-8fc9-a648328841dc" returned: 0 in 0.407s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4f79f379-363e-43a7-820a-54f3e1427212 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "cinder-3f47a0ae-4242-4e1c-ba44-be0cbd714739-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:39 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-2c9159d0-53f0-4b2d-86bc-9ab70c2120ef tempest-ProjectMemberTests-1693853425 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663.f72ba6c1-0e11-40ce-8fc9-a648328841dc is being set with open permissions: ugo+rw Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2c9159d0-53f0-4b2d-86bc-9ab70c2120ef tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663.f72ba6c1-0e11-40ce-8fc9-a648328841dc {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:39 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663.f72ba6c1-0e11-40ce-8fc9-a648328841dc Nov 06 14:46:39 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Flow 'volume_create_manager' (d76067ce-40b6-4380-9ef4-c56e26415a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8de4bd-7692-4a51-b035-6e12db1ad9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8de4bd-7692-4a51-b035-6e12db1ad9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1296327885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f74802ac-370a-4f5e-a753-2f85b3394be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1f977161a04a70864580ac4036ed52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:39Z,use_quota=True,user_id='c87e9ba9f2e24a5a993dc5a5d5484409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb912313-0862-413b-882d-b5bea99b0215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb912313-0862-413b-882d-b5bea99b0215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f996b2bb-946d-426e-b3cf-d24aa0fe1e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f996b2bb-946d-426e-b3cf-d24aa0fe1e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f74802ac-370a-4f5e-a753-2f85b3394be7', 'volume_name': 'volume-f74802ac-370a-4f5e-a753-2f85b3394be7', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f15d9a1-7f10-41e7-984c-e02f94ce36a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f15d9a1-7f10-41e7-984c-e02f94ce36a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590d51e9-74a2-4a16-a18c-76b896fb7548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:39 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Volume f74802ac-370a-4f5e-a753-2f85b3394be7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f74802ac-370a-4f5e-a753-2f85b3394be7', 'volume_size': 1} Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:39 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4f79f379-363e-43a7-820a-54f3e1427212 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "cinder-quobyte-3f47a0ae-4242-4e1c-ba44-be0cbd714739" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6a069e55-c2db-4886-ad29-423c64353277 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.348s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-6a069e55-c2db-4886-ad29-423c64353277 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:46:39 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-6a069e55-c2db-4886-ad29-423c64353277 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Deleted volume successfully. Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4f79f379-363e-43a7-820a-54f3e1427212 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "cinder-quobyte-3f47a0ae-4242-4e1c-ba44-be0cbd714739" acquired by "delete_volume" :: waited 0.026s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6a069e55-c2db-4886-ad29-423c64353277 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "cinder-a7dce830-5ef2-40e5-8cef-952e610f00d0-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[debbdbab-3a38-4f43-8bf4-82353f26c03f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4f79f379-363e-43a7-820a-54f3e1427212 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3f47a0ae-4242-4e1c-ba44-be0cbd714739 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:39 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2c9159d0-53f0-4b2d-86bc-9ab70c2120ef tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663.f72ba6c1-0e11-40ce-8fc9-a648328841dc" returned: 0 in 0.263s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2c9159d0-53f0-4b2d-86bc-9ab70c2120ef tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:39 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3f47a0ae-4242-4e1c-ba44-be0cbd714739 Nov 06 14:46:39 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:39 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663.info Nov 06 14:46:39 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:39 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2c9159d0-53f0-4b2d-86bc-9ab70c2120ef tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663.info" returned: 0 in 0.261s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:39 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-2c9159d0-53f0-4b2d-86bc-9ab70c2120ef tempest-ProjectMemberTests-1693853425 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663.info is being set with open permissions: ugo+rw Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2c9159d0-53f0-4b2d-86bc-9ab70c2120ef tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:39 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4f79f379-363e-43a7-820a-54f3e1427212 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3f47a0ae-4242-4e1c-ba44-be0cbd714739" returned: 0 in 0.388s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:39 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4f79f379-363e-43a7-820a-54f3e1427212 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3f47a0ae-4242-4e1c-ba44-be0cbd714739 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:39 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663.info Nov 06 14:46:39 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:39 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3f47a0ae-4242-4e1c-ba44-be0cbd714739 Nov 06 14:46:39 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:40 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2c9159d0-53f0-4b2d-86bc-9ab70c2120ef tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663.info" returned: 0 in 0.265s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:40 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2c9159d0-53f0-4b2d-86bc-9ab70c2120ef tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.299s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.734s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1296327885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f74802ac-370a-4f5e-a753-2f85b3394be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1f977161a04a70864580ac4036ed52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:39Z,use_quota=True,user_id='c87e9ba9f2e24a5a993dc5a5d5484409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Creating volume f74802ac-370a-4f5e-a753-2f85b3394be7 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:46:40 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f74802ac-370a-4f5e-a753-2f85b3394be7 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4f79f379-363e-43a7-820a-54f3e1427212 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3f47a0ae-4242-4e1c-ba44-be0cbd714739" returned: 0 in 0.298s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:40 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f74802ac-370a-4f5e-a753-2f85b3394be7 1073741824 Nov 06 14:46:40 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4f79f379-363e-43a7-820a-54f3e1427212 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "cinder-quobyte-3f47a0ae-4242-4e1c-ba44-be0cbd714739" released by "delete_volume" :: held 0.744s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:40 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-2c9159d0-53f0-4b2d-86bc-9ab70c2120ef tempest-ProjectMemberTests-1693853425 None] Create snapshot completed successfully Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-4f79f379-363e-43a7-820a-54f3e1427212 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Created reservations ['a60f0025-acac-4050-8adb-827bd03e8cb6', '96c0635e-ca5a-464a-b6dc-e24dc311fb32', 'e4060c6d-78cb-4505-900a-417a9994534a', '691da807-9529-473c-8f01-0fb96a72ce65'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4f79f379-363e-43a7-820a-54f3e1427212 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4f79f379-363e-43a7-820a-54f3e1427212 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4f79f379-363e-43a7-820a-54f3e1427212 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4f79f379-363e-43a7-820a-54f3e1427212 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4f79f379-363e-43a7-820a-54f3e1427212 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4f79f379-363e-43a7-820a-54f3e1427212 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:40 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:46:40 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e6a65848-b8ff-48ba-b4ba-80a868df5929 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "cinder-31b7eacc-ac59-40b3-9765-7fe314bc9b13-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e6a65848-b8ff-48ba-b4ba-80a868df5929 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "cinder-31b7eacc-ac59-40b3-9765-7fe314bc9b13-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e6a65848-b8ff-48ba-b4ba-80a868df5929 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "cinder-quobyte-31b7eacc-ac59-40b3-9765-7fe314bc9b13" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e6a65848-b8ff-48ba-b4ba-80a868df5929 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "cinder-quobyte-31b7eacc-ac59-40b3-9765-7fe314bc9b13" acquired by "delete_volume" :: waited 0.030s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd21010-dbb6-4c3a-983e-d734274b8e82]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e6a65848-b8ff-48ba-b4ba-80a868df5929 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-31b7eacc-ac59-40b3-9765-7fe314bc9b13 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:40 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4f79f379-363e-43a7-820a-54f3e1427212 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.294s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-4f79f379-363e-43a7-820a-54f3e1427212 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:46:40 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-4f79f379-363e-43a7-820a-54f3e1427212 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Deleted volume successfully. Nov 06 14:46:40 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-31b7eacc-ac59-40b3-9765-7fe314bc9b13 Nov 06 14:46:40 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4f79f379-363e-43a7-820a-54f3e1427212 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "cinder-3f47a0ae-4242-4e1c-ba44-be0cbd714739-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:40 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f74802ac-370a-4f5e-a753-2f85b3394be7 1073741824" returned: 0 in 0.528s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f74802ac-370a-4f5e-a753-2f85b3394be7 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:40 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f74802ac-370a-4f5e-a753-2f85b3394be7 Nov 06 14:46:40 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:40 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e6a65848-b8ff-48ba-b4ba-80a868df5929 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-31b7eacc-ac59-40b3-9765-7fe314bc9b13" returned: 0 in 0.440s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e6a65848-b8ff-48ba-b4ba-80a868df5929 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-31b7eacc-ac59-40b3-9765-7fe314bc9b13 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:40 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f74802ac-370a-4f5e-a753-2f85b3394be7" returned: 0 in 0.271s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:40 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-31b7eacc-ac59-40b3-9765-7fe314bc9b13 Nov 06 14:46:40 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590d51e9-74a2-4a16-a18c-76b896fb7548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f74802ac-370a-4f5e-a753-2f85b3394be7', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:40 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19012641-8cc9-45e0-ba89-9f518f76c813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b2654ece-fe7e-4146-be56-7a8b23ccbb14 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-f72ba6c1-0e11-40ce-8fc9-a648328841dc-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:41 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Volume volume-f74802ac-370a-4f5e-a753-2f85b3394be7 (f74802ac-370a-4f5e-a753-2f85b3394be7): created successfully Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19012641-8cc9-45e0-ba89-9f518f76c813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Flow 'volume_create_manager' (d76067ce-40b6-4380-9ef4-c56e26415a52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b2654ece-fe7e-4146-be56-7a8b23ccbb14 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-f72ba6c1-0e11-40ce-8fc9-a648328841dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b2654ece-fe7e-4146-be56-7a8b23ccbb14 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-quobyte-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:41 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-6b443c04-7ecb-4b0b-84e7-3be057add5d7 tempest-ProjectReaderTests-946381399 None] Created volume successfully. Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b2654ece-fe7e-4146-be56-7a8b23ccbb14 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b2654ece-fe7e-4146-be56-7a8b23ccbb14 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-quobyte-f72ba6c1-0e11-40ce-8fc9-a648328841dc" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b2654ece-fe7e-4146-be56-7a8b23ccbb14 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-f72ba6c1-0e11-40ce-8fc9-a648328841dc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-b2654ece-fe7e-4146-be56-7a8b23ccbb14 tempest-ProjectMemberTests-1693853425 None] Deleting offline snapshot f72ba6c1-0e11-40ce-8fc9-a648328841dc of volume d3ae5e56-b7b7-4b03-b70b-4cb99cc52663 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-b2654ece-fe7e-4146-be56-7a8b23ccbb14 tempest-ProjectMemberTests-1693853425 None] snapshot_file for this snap is: volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663.f72ba6c1-0e11-40ce-8fc9-a648328841dc {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[562f2184-b739-4b2c-8255-3b61acb3e604]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b2654ece-fe7e-4146-be56-7a8b23ccbb14 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663.f72ba6c1-0e11-40ce-8fc9-a648328841dc {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:41 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e6a65848-b8ff-48ba-b4ba-80a868df5929 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-31b7eacc-ac59-40b3-9765-7fe314bc9b13" returned: 0 in 0.275s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:41 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663.f72ba6c1-0e11-40ce-8fc9-a648328841dc Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e6a65848-b8ff-48ba-b4ba-80a868df5929 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "cinder-quobyte-31b7eacc-ac59-40b3-9765-7fe314bc9b13" released by "delete_volume" :: held 0.771s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:41 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-e6a65848-b8ff-48ba-b4ba-80a868df5929 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Created reservations ['6e6d5231-ad19-4aa1-97b7-b15125cae4ad', '67b9716d-9e99-48e6-9800-6d17a9d06887', '0a24f67d-c8c0-4262-8699-ffdca32498d8', 'b20449b9-20fb-4906-b500-930c73e88362'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9bdebd78-b6e4-440f-b537-0374a77bdb2f tempest-ProjectReaderTests-946381399 None] Acquiring lock "cinder-f74802ac-370a-4f5e-a753-2f85b3394be7-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9bdebd78-b6e4-440f-b537-0374a77bdb2f tempest-ProjectReaderTests-946381399 None] Lock "cinder-f74802ac-370a-4f5e-a753-2f85b3394be7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e6a65848-b8ff-48ba-b4ba-80a868df5929 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e6a65848-b8ff-48ba-b4ba-80a868df5929 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e6a65848-b8ff-48ba-b4ba-80a868df5929 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e6a65848-b8ff-48ba-b4ba-80a868df5929 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e6a65848-b8ff-48ba-b4ba-80a868df5929 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e6a65848-b8ff-48ba-b4ba-80a868df5929 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:41 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:46:41 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9bdebd78-b6e4-440f-b537-0374a77bdb2f tempest-ProjectReaderTests-946381399 None] Acquiring lock "cinder-quobyte-f74802ac-370a-4f5e-a753-2f85b3394be7" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9bdebd78-b6e4-440f-b537-0374a77bdb2f tempest-ProjectReaderTests-946381399 None] Lock "cinder-quobyte-f74802ac-370a-4f5e-a753-2f85b3394be7" acquired by "delete_volume" :: waited 0.018s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad29429-7c5f-40e4-8ee3-183fee896aad]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9bdebd78-b6e4-440f-b537-0374a77bdb2f tempest-ProjectReaderTests-946381399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f74802ac-370a-4f5e-a753-2f85b3394be7 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:41 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b2654ece-fe7e-4146-be56-7a8b23ccbb14 tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663.f72ba6c1-0e11-40ce-8fc9-a648328841dc" returned: 0 in 0.444s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-b2654ece-fe7e-4146-be56-7a8b23ccbb14 tempest-ProjectMemberTests-1693853425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6ff2d8bc-830f-4206-9ef7-e4c843a02207 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "cinder-e651964f-6340-406b-9ad6-1cdb1f547b5e-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[09214489-5b89-4f76-a7d0-e69d65edd8b3]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b2654ece-fe7e-4146-be56-7a8b23ccbb14 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6ff2d8bc-830f-4206-9ef7-e4c843a02207 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "cinder-e651964f-6340-406b-9ad6-1cdb1f547b5e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:41 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f74802ac-370a-4f5e-a753-2f85b3394be7 Nov 06 14:46:41 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6ff2d8bc-830f-4206-9ef7-e4c843a02207 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "cinder-quobyte-e651964f-6340-406b-9ad6-1cdb1f547b5e" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6ff2d8bc-830f-4206-9ef7-e4c843a02207 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "cinder-quobyte-e651964f-6340-406b-9ad6-1cdb1f547b5e" acquired by "delete_volume" :: waited 0.021s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[7895bd22-0879-4124-9603-f818e906433d]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6ff2d8bc-830f-4206-9ef7-e4c843a02207 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e651964f-6340-406b-9ad6-1cdb1f547b5e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:41 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663 Nov 06 14:46:41 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:41 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e6a65848-b8ff-48ba-b4ba-80a868df5929 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.399s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-e6a65848-b8ff-48ba-b4ba-80a868df5929 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:46:41 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-e6a65848-b8ff-48ba-b4ba-80a868df5929 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Deleted volume successfully. Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e6a65848-b8ff-48ba-b4ba-80a868df5929 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "cinder-31b7eacc-ac59-40b3-9765-7fe314bc9b13-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:41 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e651964f-6340-406b-9ad6-1cdb1f547b5e Nov 06 14:46:41 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:41 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9bdebd78-b6e4-440f-b537-0374a77bdb2f tempest-ProjectReaderTests-946381399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f74802ac-370a-4f5e-a753-2f85b3394be7" returned: 0 in 0.458s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:41 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9bdebd78-b6e4-440f-b537-0374a77bdb2f tempest-ProjectReaderTests-946381399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f74802ac-370a-4f5e-a753-2f85b3394be7 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:42 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f74802ac-370a-4f5e-a753-2f85b3394be7 Nov 06 14:46:42 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:42 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b2654ece-fe7e-4146-be56-7a8b23ccbb14 tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663" returned: 0 in 0.446s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b2654ece-fe7e-4146-be56-7a8b23ccbb14 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663.f72ba6c1-0e11-40ce-8fc9-a648328841dc {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:42 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663.f72ba6c1-0e11-40ce-8fc9-a648328841dc Nov 06 14:46:42 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:42 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6ff2d8bc-830f-4206-9ef7-e4c843a02207 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e651964f-6340-406b-9ad6-1cdb1f547b5e" returned: 0 in 0.429s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6ff2d8bc-830f-4206-9ef7-e4c843a02207 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e651964f-6340-406b-9ad6-1cdb1f547b5e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:42 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e651964f-6340-406b-9ad6-1cdb1f547b5e Nov 06 14:46:42 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:42 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9bdebd78-b6e4-440f-b537-0374a77bdb2f tempest-ProjectReaderTests-946381399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-f74802ac-370a-4f5e-a753-2f85b3394be7" returned: 0 in 0.278s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9bdebd78-b6e4-440f-b537-0374a77bdb2f tempest-ProjectReaderTests-946381399 None] Lock "cinder-quobyte-f74802ac-370a-4f5e-a753-2f85b3394be7" released by "delete_volume" :: held 0.792s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-9bdebd78-b6e4-440f-b537-0374a77bdb2f tempest-ProjectReaderTests-946381399 None] Created reservations ['0921255d-7c8d-4a2e-8e19-20c3e88151e2', 'a60d10aa-4d50-4b09-a5db-b03bc9384f19', '84c9b40e-0404-4661-850c-55cb465223b1', '9f5e577c-fc4f-4346-94ec-a0d812b87d97'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9bdebd78-b6e4-440f-b537-0374a77bdb2f tempest-ProjectReaderTests-946381399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9bdebd78-b6e4-440f-b537-0374a77bdb2f tempest-ProjectReaderTests-946381399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9bdebd78-b6e4-440f-b537-0374a77bdb2f tempest-ProjectReaderTests-946381399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9bdebd78-b6e4-440f-b537-0374a77bdb2f tempest-ProjectReaderTests-946381399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9bdebd78-b6e4-440f-b537-0374a77bdb2f tempest-ProjectReaderTests-946381399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9bdebd78-b6e4-440f-b537-0374a77bdb2f tempest-ProjectReaderTests-946381399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:42 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:46:42 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:42 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6ff2d8bc-830f-4206-9ef7-e4c843a02207 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-e651964f-6340-406b-9ad6-1cdb1f547b5e" returned: 0 in 0.294s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6ff2d8bc-830f-4206-9ef7-e4c843a02207 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "cinder-quobyte-e651964f-6340-406b-9ad6-1cdb1f547b5e" released by "delete_volume" :: held 0.794s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:42 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b2654ece-fe7e-4146-be56-7a8b23ccbb14 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663.f72ba6c1-0e11-40ce-8fc9-a648328841dc" returned: 0 in 0.445s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b2654ece-fe7e-4146-be56-7a8b23ccbb14 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663.f72ba6c1-0e11-40ce-8fc9-a648328841dc {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:42 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663.f72ba6c1-0e11-40ce-8fc9-a648328841dc Nov 06 14:46:42 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-6ff2d8bc-830f-4206-9ef7-e4c843a02207 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Created reservations ['1b19eb0d-fed8-479d-8887-dd05548b3760', '7be741c0-4474-47d1-8add-2af16c312540', '2bebc410-a825-47e4-acde-66b3ed79a9e5', '4ac3333e-971c-416d-a4e5-4f129235ef7b'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6ff2d8bc-830f-4206-9ef7-e4c843a02207 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6ff2d8bc-830f-4206-9ef7-e4c843a02207 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6ff2d8bc-830f-4206-9ef7-e4c843a02207 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-6ff2d8bc-830f-4206-9ef7-e4c843a02207 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-6ff2d8bc-830f-4206-9ef7-e4c843a02207 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6ff2d8bc-830f-4206-9ef7-e4c843a02207 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:42 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:42 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9bdebd78-b6e4-440f-b537-0374a77bdb2f tempest-ProjectReaderTests-946381399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.301s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:42 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-9bdebd78-b6e4-440f-b537-0374a77bdb2f tempest-ProjectReaderTests-946381399 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:46:42 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-9bdebd78-b6e4-440f-b537-0374a77bdb2f tempest-ProjectReaderTests-946381399 None] Deleted volume successfully. Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-9bdebd78-b6e4-440f-b537-0374a77bdb2f tempest-ProjectReaderTests-946381399 None] Lock "cinder-f74802ac-370a-4f5e-a753-2f85b3394be7-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:42 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b2654ece-fe7e-4146-be56-7a8b23ccbb14 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663.f72ba6c1-0e11-40ce-8fc9-a648328841dc" returned: 0 in 0.354s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b2654ece-fe7e-4146-be56-7a8b23ccbb14 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-f72ba6c1-0e11-40ce-8fc9-a648328841dc" released by "_delete_snapshot" :: held 1.857s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:42 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b2654ece-fe7e-4146-be56-7a8b23ccbb14 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663" released by "delete_snapshot" :: held 1.882s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-b2654ece-fe7e-4146-be56-7a8b23ccbb14 tempest-ProjectMemberTests-1693853425 None] Created reservations ['aaee518a-aab7-43f1-848f-040d5421c2e1', 'bc1f302d-8623-4374-895d-16a7ea470bf1', 'b37ccf6f-a0af-4d7f-a63c-9e3951ea5def', 'ea9a8c56-3606-44c0-baab-4418b7c63aac'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:43 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-6ff2d8bc-830f-4206-9ef7-e4c843a02207 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.420s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-6ff2d8bc-830f-4206-9ef7-e4c843a02207 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:46:43 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-6ff2d8bc-830f-4206-9ef7-e4c843a02207 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Deleted volume successfully. Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Flow 'volume_create_manager' (07d823bf-5721-41d9-997d-c2d156a82428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8445a1-b243-49a0-970c-f466b76e9e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-6ff2d8bc-830f-4206-9ef7-e4c843a02207 tempest-CreateVolumesFromSourceVolumeTest-1960883084 None] Lock "cinder-e651964f-6340-406b-9ad6-1cdb1f547b5e-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8445a1-b243-49a0-970c-f466b76e9e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1128713983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3d23693-0439-4268-af33-c3e41e2c35cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1f977161a04a70864580ac4036ed52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:43Z,use_quota=True,user_id='c87e9ba9f2e24a5a993dc5a5d5484409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2575cbbe-e19f-4b12-b0f7-e5ba0d174861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2575cbbe-e19f-4b12-b0f7-e5ba0d174861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4acac3da-52ac-4070-93c0-8643888d3e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4acac3da-52ac-4070-93c0-8643888d3e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3d23693-0439-4268-af33-c3e41e2c35cd', 'volume_name': 'volume-d3d23693-0439-4268-af33-c3e41e2c35cd', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba1656c-8881-40ed-ae63-880ed89fb46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba1656c-8881-40ed-ae63-880ed89fb46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3661070-8078-4d97-b487-2a57ebfcb79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:43 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Volume d3d23693-0439-4268-af33-c3e41e2c35cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3d23693-0439-4268-af33-c3e41e2c35cd', 'volume_size': 1} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1128713983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3d23693-0439-4268-af33-c3e41e2c35cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1f977161a04a70864580ac4036ed52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:43Z,use_quota=True,user_id='c87e9ba9f2e24a5a993dc5a5d5484409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Creating volume d3d23693-0439-4268-af33-c3e41e2c35cd {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:46:43 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3d23693-0439-4268-af33-c3e41e2c35cd 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-88663de5-19aa-4289-973e-2c9805fbb44e tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:43 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-b2654ece-fe7e-4146-be56-7a8b23ccbb14 tempest-ProjectMemberTests-1693853425 None] Delete snapshot completed successfully. Nov 06 14:46:43 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3d23693-0439-4268-af33-c3e41e2c35cd 1073741824 Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-88663de5-19aa-4289-973e-2c9805fbb44e tempest-ProjectMemberTests-1693853425 None] Lock "cinder-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:43 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b2654ece-fe7e-4146-be56-7a8b23ccbb14 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-f72ba6c1-0e11-40ce-8fc9-a648328841dc-delete_snapshot" released by "delete_snapshot" :: held 2.263s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-88663de5-19aa-4289-973e-2c9805fbb44e tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-quobyte-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-88663de5-19aa-4289-973e-2c9805fbb44e tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663" acquired by "delete_volume" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60facfe-7a10-4cf0-9cbd-f9910156edb7]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-88663de5-19aa-4289-973e-2c9805fbb44e tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:43 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663 Nov 06 14:46:43 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:43 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3d23693-0439-4268-af33-c3e41e2c35cd 1073741824" returned: 0 in 0.547s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3d23693-0439-4268-af33-c3e41e2c35cd {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:43 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-88663de5-19aa-4289-973e-2c9805fbb44e tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663" returned: 0 in 0.473s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:43 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-88663de5-19aa-4289-973e-2c9805fbb44e tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:43 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3d23693-0439-4268-af33-c3e41e2c35cd Nov 06 14:46:43 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:43 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663 Nov 06 14:46:43 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:44 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-88663de5-19aa-4289-973e-2c9805fbb44e tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663" returned: 0 in 0.268s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:44 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3d23693-0439-4268-af33-c3e41e2c35cd" returned: 0 in 0.309s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-88663de5-19aa-4289-973e-2c9805fbb44e tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663" released by "delete_volume" :: held 0.817s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3661070-8078-4d97-b487-2a57ebfcb79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3d23693-0439-4268-af33-c3e41e2c35cd', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a7e787-8272-43e0-8f60-c00627c31741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:44 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Volume volume-d3d23693-0439-4268-af33-c3e41e2c35cd (d3d23693-0439-4268-af33-c3e41e2c35cd): created successfully Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a7e787-8272-43e0-8f60-c00627c31741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Flow 'volume_create_manager' (07d823bf-5721-41d9-997d-c2d156a82428) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:44 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-c4f5d8f1-f5a1-4a39-96ec-5ab016addc88 tempest-ProjectReaderTests-946381399 None] Created volume successfully. Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-88663de5-19aa-4289-973e-2c9805fbb44e tempest-ProjectMemberTests-1693853425 None] Created reservations ['a14814ce-e8d8-4603-a0f0-ef754ca8a0fb', 'fe909c9d-8022-410b-bc29-788b1902f6bd', '7965948a-637f-4630-94ca-d4fd2debc43a', '8879d670-efc4-4822-af40-b608ce634e53'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-88663de5-19aa-4289-973e-2c9805fbb44e tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-88663de5-19aa-4289-973e-2c9805fbb44e tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-88663de5-19aa-4289-973e-2c9805fbb44e tempest-ProjectMemberTests-1693853425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-88663de5-19aa-4289-973e-2c9805fbb44e tempest-ProjectMemberTests-1693853425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-88663de5-19aa-4289-973e-2c9805fbb44e tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-88663de5-19aa-4289-973e-2c9805fbb44e tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:44 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:46:44 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:44 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-88663de5-19aa-4289-973e-2c9805fbb44e tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.276s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-88663de5-19aa-4289-973e-2c9805fbb44e tempest-ProjectMemberTests-1693853425 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:46:44 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-88663de5-19aa-4289-973e-2c9805fbb44e tempest-ProjectMemberTests-1693853425 None] Deleted volume successfully. Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-88663de5-19aa-4289-973e-2c9805fbb44e tempest-ProjectMemberTests-1693853425 None] Lock "cinder-d3ae5e56-b7b7-4b03-b70b-4cb99cc52663-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Flow 'volume_create_manager' (3f761a08-0fa8-4282-a249-0cc91773853d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5900fb2d-8ed7-4d57-b919-64efb5e409d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5900fb2d-8ed7-4d57-b919-64efb5e409d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-934883044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c58fae-0af8-46cd-b8d8-65eba8638cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='babad70bf4064f0c988ad5aee77822ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:45Z,use_quota=True,user_id='874776ea9ab343e5a2850727553c4735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214d700d-3e7e-463d-b5ee-25cb78172c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214d700d-3e7e-463d-b5ee-25cb78172c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b0cd316-7ad8-48e3-bd77-58722776ef70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b0cd316-7ad8-48e3-bd77-58722776ef70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61c58fae-0af8-46cd-b8d8-65eba8638cf1', 'volume_name': 'volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf025f43-7094-48dc-b377-975754ee7b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf025f43-7094-48dc-b377-975754ee7b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f07741-f9af-4b39-9188-f3ebcd25b394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:44 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Volume 61c58fae-0af8-46cd-b8d8-65eba8638cf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1', 'volume_size': 1} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-934883044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c58fae-0af8-46cd-b8d8-65eba8638cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='babad70bf4064f0c988ad5aee77822ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:45Z,use_quota=True,user_id='874776ea9ab343e5a2850727553c4735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Creating volume 61c58fae-0af8-46cd-b8d8-65eba8638cf1 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:46:44 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:46:44 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:44 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1 1073741824 Nov 06 14:46:44 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-35fe6b68-ddf5-4fbc-b399-86173f4ce5a1 tempest-ProjectReaderTests-946381399 None] Acquiring lock "cinder-d3d23693-0439-4268-af33-c3e41e2c35cd-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-35fe6b68-ddf5-4fbc-b399-86173f4ce5a1 tempest-ProjectReaderTests-946381399 None] Lock "cinder-d3d23693-0439-4268-af33-c3e41e2c35cd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-35fe6b68-ddf5-4fbc-b399-86173f4ce5a1 tempest-ProjectReaderTests-946381399 None] Acquiring lock "cinder-quobyte-d3d23693-0439-4268-af33-c3e41e2c35cd" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:45 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-35fe6b68-ddf5-4fbc-b399-86173f4ce5a1 tempest-ProjectReaderTests-946381399 None] Lock "cinder-quobyte-d3d23693-0439-4268-af33-c3e41e2c35cd" acquired by "delete_volume" :: waited 0.018s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:45 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcc6c4d-d277-4e2f-aed5-ff3701a780e2]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-35fe6b68-ddf5-4fbc-b399-86173f4ce5a1 tempest-ProjectReaderTests-946381399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3d23693-0439-4268-af33-c3e41e2c35cd {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:45 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1 1073741824" returned: 0 in 0.509s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:45 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3d23693-0439-4268-af33-c3e41e2c35cd Nov 06 14:46:45 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:45 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1 Nov 06 14:46:45 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:45 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-35fe6b68-ddf5-4fbc-b399-86173f4ce5a1 tempest-ProjectReaderTests-946381399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3d23693-0439-4268-af33-c3e41e2c35cd" returned: 0 in 0.400s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-35fe6b68-ddf5-4fbc-b399-86173f4ce5a1 tempest-ProjectReaderTests-946381399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3d23693-0439-4268-af33-c3e41e2c35cd {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:45 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3d23693-0439-4268-af33-c3e41e2c35cd Nov 06 14:46:45 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:45 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1" returned: 0 in 0.301s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:45 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:46:45 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f07741-f9af-4b39-9188-f3ebcd25b394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caa73ee7-9f8d-446e-b1ec-31f2818bec2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:45 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Volume volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1 (61c58fae-0af8-46cd-b8d8-65eba8638cf1): created successfully Nov 06 14:46:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caa73ee7-9f8d-446e-b1ec-31f2818bec2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:45 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Flow 'volume_create_manager' (3f761a08-0fa8-4282-a249-0cc91773853d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:45 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-7322277f-0f8b-4052-8a1d-f2df6a9f8fdb tempest-ProjectMemberTests-1693853425 None] Created volume successfully. Nov 06 14:46:46 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-35fe6b68-ddf5-4fbc-b399-86173f4ce5a1 tempest-ProjectReaderTests-946381399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-d3d23693-0439-4268-af33-c3e41e2c35cd" returned: 0 in 0.277s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-35fe6b68-ddf5-4fbc-b399-86173f4ce5a1 tempest-ProjectReaderTests-946381399 None] Lock "cinder-quobyte-d3d23693-0439-4268-af33-c3e41e2c35cd" released by "delete_volume" :: held 0.724s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-35fe6b68-ddf5-4fbc-b399-86173f4ce5a1 tempest-ProjectReaderTests-946381399 None] Created reservations ['e7c95e21-23db-4c51-a973-d8f3b1ee9e6d', '7f0696f8-1daf-475f-ac79-3e30981c4409', '9a828958-2a20-4b97-abfd-987c0ade476c', 'a16c826b-29f3-4602-9e2a-e93d8ce882c2'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-35fe6b68-ddf5-4fbc-b399-86173f4ce5a1 tempest-ProjectReaderTests-946381399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-35fe6b68-ddf5-4fbc-b399-86173f4ce5a1 tempest-ProjectReaderTests-946381399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-35fe6b68-ddf5-4fbc-b399-86173f4ce5a1 tempest-ProjectReaderTests-946381399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-35fe6b68-ddf5-4fbc-b399-86173f4ce5a1 tempest-ProjectReaderTests-946381399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-35fe6b68-ddf5-4fbc-b399-86173f4ce5a1 tempest-ProjectReaderTests-946381399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-35fe6b68-ddf5-4fbc-b399-86173f4ce5a1 tempest-ProjectReaderTests-946381399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:46 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:46:46 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:46 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-35fe6b68-ddf5-4fbc-b399-86173f4ce5a1 tempest-ProjectReaderTests-946381399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.262s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-35fe6b68-ddf5-4fbc-b399-86173f4ce5a1 tempest-ProjectReaderTests-946381399 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:46:46 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-35fe6b68-ddf5-4fbc-b399-86173f4ce5a1 tempest-ProjectReaderTests-946381399 None] Deleted volume successfully. Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-35fe6b68-ddf5-4fbc-b399-86173f4ce5a1 tempest-ProjectReaderTests-946381399 None] Lock "cinder-d3d23693-0439-4268-af33-c3e41e2c35cd-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Flow 'volume_create_manager' (634bbdff-f557-4f51-abf5-5f2d8daf41f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5483e3f5-91a7-45de-8a7d-a9463689fc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5483e3f5-91a7-45de-8a7d-a9463689fc79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1819507813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b0db861-ed59-4b1b-a2ed-ef131de8b503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f90f94b028bb4f3d866fc4b4ef171818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:47Z,use_quota=True,user_id='6b0a7a9d8c014b02a857c1931fd0d85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (409efa86-3737-4330-807a-7f9e385a400d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (409efa86-3737-4330-807a-7f9e385a400d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b619f6-d410-4db0-8ee3-f946f3f69290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b619f6-d410-4db0-8ee3-f946f3f69290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b0db861-ed59-4b1b-a2ed-ef131de8b503', 'volume_name': 'volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31ad3d9a-e037-48a1-9df4-92c7d8efa866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31ad3d9a-e037-48a1-9df4-92c7d8efa866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86baa56d-49c2-4fd5-9cdc-aa46ea39f8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:46 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Volume 1b0db861-ed59-4b1b-a2ed-ef131de8b503: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503', 'volume_size': 1} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1819507813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b0db861-ed59-4b1b-a2ed-ef131de8b503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f90f94b028bb4f3d866fc4b4ef171818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:47Z,use_quota=True,user_id='6b0a7a9d8c014b02a857c1931fd0d85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Creating volume 1b0db861-ed59-4b1b-a2ed-ef131de8b503 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:46:46 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:46:46 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:47 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503 1073741824 Nov 06 14:46:47 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4b3ad0b3-e453-458c-86b1-1a74ecfe45f2 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:47 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503 1073741824" returned: 0 in 0.493s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:47 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503 Nov 06 14:46:47 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:47 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503" returned: 0 in 0.269s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:47 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:46:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4b3ad0b3-e453-458c-86b1-1a74ecfe45f2 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.655s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:47 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86baa56d-49c2-4fd5-9cdc-aa46ea39f8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:47 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d08a52c5-37d6-4545-9c5a-6f8b869e4e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:47 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-4b3ad0b3-e453-458c-86b1-1a74ecfe45f2 tempest-ProjectMemberTests-1693853425 None] Creating offline snapshot f93a680c-eb34-4fcc-9abe-cb4627afdc8e of volume 61c58fae-0af8-46cd-b8d8-65eba8638cf1 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:46:47 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef8f267-e86e-4490-a0fc-e0c3e7b05233]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:47 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b3ad0b3-e453-458c-86b1-1a74ecfe45f2 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:47 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Volume volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503 (1b0db861-ed59-4b1b-a2ed-ef131de8b503): created successfully Nov 06 14:46:47 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d08a52c5-37d6-4545-9c5a-6f8b869e4e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:47 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Flow 'volume_create_manager' (634bbdff-f557-4f51-abf5-5f2d8daf41f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:47 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1 Nov 06 14:46:47 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:48 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-e2a3c372-c7da-42af-8097-ebf8319771d8 tempest-ProjectReaderTests-1181373823 None] Created volume successfully. Nov 06 14:46:48 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b3ad0b3-e453-458c-86b1-1a74ecfe45f2 tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1" returned: 0 in 0.379s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b3ad0b3-e453-458c-86b1-1a74ecfe45f2 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1.f93a680c-eb34-4fcc-9abe-cb4627afdc8e 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:48 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1.f93a680c-eb34-4fcc-9abe-cb4627afdc8e 1G Nov 06 14:46:48 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:48 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b3ad0b3-e453-458c-86b1-1a74ecfe45f2 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1.f93a680c-eb34-4fcc-9abe-cb4627afdc8e 1G" returned: 0 in 0.404s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b3ad0b3-e453-458c-86b1-1a74ecfe45f2 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1.f93a680c-eb34-4fcc-9abe-cb4627afdc8e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:48 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1.f93a680c-eb34-4fcc-9abe-cb4627afdc8e Nov 06 14:46:48 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:48 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b3ad0b3-e453-458c-86b1-1a74ecfe45f2 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1.f93a680c-eb34-4fcc-9abe-cb4627afdc8e" returned: 0 in 0.293s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:48 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-4b3ad0b3-e453-458c-86b1-1a74ecfe45f2 tempest-ProjectMemberTests-1693853425 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1.f93a680c-eb34-4fcc-9abe-cb4627afdc8e is being set with open permissions: ugo+rw Nov 06 14:46:48 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b3ad0b3-e453-458c-86b1-1a74ecfe45f2 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1.f93a680c-eb34-4fcc-9abe-cb4627afdc8e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:48 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1.f93a680c-eb34-4fcc-9abe-cb4627afdc8e Nov 06 14:46:48 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:49 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b3ad0b3-e453-458c-86b1-1a74ecfe45f2 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1.f93a680c-eb34-4fcc-9abe-cb4627afdc8e" returned: 0 in 0.255s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b3ad0b3-e453-458c-86b1-1a74ecfe45f2 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:49 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1.info Nov 06 14:46:49 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:49 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b3ad0b3-e453-458c-86b1-1a74ecfe45f2 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1.info" returned: 0 in 0.248s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:49 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-4b3ad0b3-e453-458c-86b1-1a74ecfe45f2 tempest-ProjectMemberTests-1693853425 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1.info is being set with open permissions: ugo+rw Nov 06 14:46:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b3ad0b3-e453-458c-86b1-1a74ecfe45f2 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:49 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1.info Nov 06 14:46:49 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:49 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4b3ad0b3-e453-458c-86b1-1a74ecfe45f2 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1.info" returned: 0 in 0.239s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:49 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4b3ad0b3-e453-458c-86b1-1a74ecfe45f2 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.196s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:50 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-4b3ad0b3-e453-458c-86b1-1a74ecfe45f2 tempest-ProjectMemberTests-1693853425 None] Create snapshot completed successfully Nov 06 14:46:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2ff24130-cc9a-42ce-85e5-f54dc55a8e13 tempest-ProjectReaderTests-1181373823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2ff24130-cc9a-42ce-85e5-f54dc55a8e13 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:50 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-2ff24130-cc9a-42ce-85e5-f54dc55a8e13 tempest-ProjectReaderTests-1181373823 None] Creating offline snapshot fb1aa5a3-1784-41ab-a1a0-f4351b16304f of volume 1b0db861-ed59-4b1b-a2ed-ef131de8b503 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:46:50 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[614bf064-76a7-4359-8abe-80093cba45b2]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:50 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2ff24130-cc9a-42ce-85e5-f54dc55a8e13 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:51 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503 Nov 06 14:46:51 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:51 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2ff24130-cc9a-42ce-85e5-f54dc55a8e13 tempest-ProjectReaderTests-1181373823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503" returned: 0 in 0.357s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2ff24130-cc9a-42ce-85e5-f54dc55a8e13 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503.fb1aa5a3-1784-41ab-a1a0-f4351b16304f 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:51 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503.fb1aa5a3-1784-41ab-a1a0-f4351b16304f 1G Nov 06 14:46:51 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:51 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2ff24130-cc9a-42ce-85e5-f54dc55a8e13 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503.fb1aa5a3-1784-41ab-a1a0-f4351b16304f 1G" returned: 0 in 0.395s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2ff24130-cc9a-42ce-85e5-f54dc55a8e13 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503.fb1aa5a3-1784-41ab-a1a0-f4351b16304f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:51 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503.fb1aa5a3-1784-41ab-a1a0-f4351b16304f Nov 06 14:46:51 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:51 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-577e8019-c07c-4c26-947b-996be8237118 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-f93a680c-eb34-4fcc-9abe-cb4627afdc8e-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:51 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-577e8019-c07c-4c26-947b-996be8237118 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-f93a680c-eb34-4fcc-9abe-cb4627afdc8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:51 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-577e8019-c07c-4c26-947b-996be8237118 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-quobyte-61c58fae-0af8-46cd-b8d8-65eba8638cf1" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:51 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-577e8019-c07c-4c26-947b-996be8237118 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-61c58fae-0af8-46cd-b8d8-65eba8638cf1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:51 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-577e8019-c07c-4c26-947b-996be8237118 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-quobyte-f93a680c-eb34-4fcc-9abe-cb4627afdc8e" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:51 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-577e8019-c07c-4c26-947b-996be8237118 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-f93a680c-eb34-4fcc-9abe-cb4627afdc8e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-577e8019-c07c-4c26-947b-996be8237118 tempest-ProjectMemberTests-1693853425 None] Deleting offline snapshot f93a680c-eb34-4fcc-9abe-cb4627afdc8e of volume 61c58fae-0af8-46cd-b8d8-65eba8638cf1 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:46:51 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-577e8019-c07c-4c26-947b-996be8237118 tempest-ProjectMemberTests-1693853425 None] snapshot_file for this snap is: volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1.f93a680c-eb34-4fcc-9abe-cb4627afdc8e {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:46:51 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c2950c-27b8-4913-a699-3101955f7fc4]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-577e8019-c07c-4c26-947b-996be8237118 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1.f93a680c-eb34-4fcc-9abe-cb4627afdc8e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:51 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2ff24130-cc9a-42ce-85e5-f54dc55a8e13 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503.fb1aa5a3-1784-41ab-a1a0-f4351b16304f" returned: 0 in 0.301s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:51 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-2ff24130-cc9a-42ce-85e5-f54dc55a8e13 tempest-ProjectReaderTests-1181373823 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503.fb1aa5a3-1784-41ab-a1a0-f4351b16304f is being set with open permissions: ugo+rw Nov 06 14:46:51 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2ff24130-cc9a-42ce-85e5-f54dc55a8e13 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503.fb1aa5a3-1784-41ab-a1a0-f4351b16304f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:51 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503.fb1aa5a3-1784-41ab-a1a0-f4351b16304f Nov 06 14:46:51 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:52 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1.f93a680c-eb34-4fcc-9abe-cb4627afdc8e Nov 06 14:46:52 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:52 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2ff24130-cc9a-42ce-85e5-f54dc55a8e13 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503.fb1aa5a3-1784-41ab-a1a0-f4351b16304f" returned: 0 in 0.258s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:52 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-577e8019-c07c-4c26-947b-996be8237118 tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1.f93a680c-eb34-4fcc-9abe-cb4627afdc8e" returned: 0 in 0.369s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:52 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-577e8019-c07c-4c26-947b-996be8237118 tempest-ProjectMemberTests-1693853425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:46:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2ff24130-cc9a-42ce-85e5-f54dc55a8e13 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:52 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4ca28b-19cf-4c86-9a69-43f790a8ca15]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-577e8019-c07c-4c26-947b-996be8237118 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:52 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503.info Nov 06 14:46:52 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:52 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1 Nov 06 14:46:52 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:52 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2ff24130-cc9a-42ce-85e5-f54dc55a8e13 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503.info" returned: 0 in 0.255s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:52 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-2ff24130-cc9a-42ce-85e5-f54dc55a8e13 tempest-ProjectReaderTests-1181373823 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503.info is being set with open permissions: ugo+rw Nov 06 14:46:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2ff24130-cc9a-42ce-85e5-f54dc55a8e13 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:52 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503.info Nov 06 14:46:52 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:52 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-577e8019-c07c-4c26-947b-996be8237118 tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1" returned: 0 in 0.365s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-577e8019-c07c-4c26-947b-996be8237118 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1.f93a680c-eb34-4fcc-9abe-cb4627afdc8e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:52 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1.f93a680c-eb34-4fcc-9abe-cb4627afdc8e Nov 06 14:46:52 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:52 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2ff24130-cc9a-42ce-85e5-f54dc55a8e13 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503.info" returned: 0 in 0.247s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2ff24130-cc9a-42ce-85e5-f54dc55a8e13 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.204s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:52 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-2ff24130-cc9a-42ce-85e5-f54dc55a8e13 tempest-ProjectReaderTests-1181373823 None] Create snapshot completed successfully Nov 06 14:46:52 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-577e8019-c07c-4c26-947b-996be8237118 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1.f93a680c-eb34-4fcc-9abe-cb4627afdc8e" returned: 0 in 0.327s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:52 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-577e8019-c07c-4c26-947b-996be8237118 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1.f93a680c-eb34-4fcc-9abe-cb4627afdc8e {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:53 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1.f93a680c-eb34-4fcc-9abe-cb4627afdc8e Nov 06 14:46:53 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:53 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-577e8019-c07c-4c26-947b-996be8237118 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1.f93a680c-eb34-4fcc-9abe-cb4627afdc8e" returned: 0 in 0.251s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-577e8019-c07c-4c26-947b-996be8237118 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-f93a680c-eb34-4fcc-9abe-cb4627afdc8e" released by "_delete_snapshot" :: held 1.430s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-577e8019-c07c-4c26-947b-996be8237118 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-61c58fae-0af8-46cd-b8d8-65eba8638cf1" released by "delete_snapshot" :: held 1.455s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:53 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-577e8019-c07c-4c26-947b-996be8237118 tempest-ProjectMemberTests-1693853425 None] Created reservations ['2ff8c3ae-8837-4a74-a427-32abc1fa6f3b', '22401daa-c21f-48af-a5c1-976755f532c9', '1be1d3ad-0801-4429-bbc2-32004579735f', 'ee0ad83f-3f54-4df0-abb9-ee6eb72e6ae8'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:53 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-577e8019-c07c-4c26-947b-996be8237118 tempest-ProjectMemberTests-1693853425 None] Delete snapshot completed successfully. Nov 06 14:46:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-577e8019-c07c-4c26-947b-996be8237118 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-f93a680c-eb34-4fcc-9abe-cb4627afdc8e-delete_snapshot" released by "delete_snapshot" :: held 1.750s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-0e9480e9-d3d6-44b3-bb0b-99056a599613 tempest-ProjectReaderTests-1181373823 None] Acquiring lock "cinder-fb1aa5a3-1784-41ab-a1a0-f4351b16304f-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-0e9480e9-d3d6-44b3-bb0b-99056a599613 tempest-ProjectReaderTests-1181373823 None] Lock "cinder-fb1aa5a3-1784-41ab-a1a0-f4351b16304f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-0e9480e9-d3d6-44b3-bb0b-99056a599613 tempest-ProjectReaderTests-1181373823 None] Acquiring lock "cinder-quobyte-1b0db861-ed59-4b1b-a2ed-ef131de8b503" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-0e9480e9-d3d6-44b3-bb0b-99056a599613 tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-1b0db861-ed59-4b1b-a2ed-ef131de8b503" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-0e9480e9-d3d6-44b3-bb0b-99056a599613 tempest-ProjectReaderTests-1181373823 None] Acquiring lock "cinder-quobyte-fb1aa5a3-1784-41ab-a1a0-f4351b16304f" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-0e9480e9-d3d6-44b3-bb0b-99056a599613 tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-fb1aa5a3-1784-41ab-a1a0-f4351b16304f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:53 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-0e9480e9-d3d6-44b3-bb0b-99056a599613 tempest-ProjectReaderTests-1181373823 None] Deleting offline snapshot fb1aa5a3-1784-41ab-a1a0-f4351b16304f of volume 1b0db861-ed59-4b1b-a2ed-ef131de8b503 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:46:53 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-0e9480e9-d3d6-44b3-bb0b-99056a599613 tempest-ProjectReaderTests-1181373823 None] snapshot_file for this snap is: volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503.fb1aa5a3-1784-41ab-a1a0-f4351b16304f {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:46:53 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb39d744-73b8-4905-b451-81e1b69c99be]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:53 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0e9480e9-d3d6-44b3-bb0b-99056a599613 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503.fb1aa5a3-1784-41ab-a1a0-f4351b16304f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:53 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503.fb1aa5a3-1784-41ab-a1a0-f4351b16304f Nov 06 14:46:53 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:53 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c4412f0d-23a5-4248-b595-4a5f45250c2c tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-61c58fae-0af8-46cd-b8d8-65eba8638cf1-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:54 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c4412f0d-23a5-4248-b595-4a5f45250c2c tempest-ProjectMemberTests-1693853425 None] Lock "cinder-61c58fae-0af8-46cd-b8d8-65eba8638cf1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:54 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c4412f0d-23a5-4248-b595-4a5f45250c2c tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-quobyte-61c58fae-0af8-46cd-b8d8-65eba8638cf1" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:54 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c4412f0d-23a5-4248-b595-4a5f45250c2c tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-61c58fae-0af8-46cd-b8d8-65eba8638cf1" acquired by "delete_volume" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:54 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d493212-d9b5-481c-b23f-a7cbba680444]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c4412f0d-23a5-4248-b595-4a5f45250c2c tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:54 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0e9480e9-d3d6-44b3-bb0b-99056a599613 tempest-ProjectReaderTests-1181373823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503.fb1aa5a3-1784-41ab-a1a0-f4351b16304f" returned: 0 in 0.372s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-0e9480e9-d3d6-44b3-bb0b-99056a599613 tempest-ProjectReaderTests-1181373823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:46:54 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dea6a91-dbb7-4157-8cdb-7c515ac530fe]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0e9480e9-d3d6-44b3-bb0b-99056a599613 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:54 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1 Nov 06 14:46:54 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:54 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503 Nov 06 14:46:54 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:54 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c4412f0d-23a5-4248-b595-4a5f45250c2c tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1" returned: 0 in 0.356s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c4412f0d-23a5-4248-b595-4a5f45250c2c tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:54 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1 Nov 06 14:46:54 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:54 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0e9480e9-d3d6-44b3-bb0b-99056a599613 tempest-ProjectReaderTests-1181373823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503" returned: 0 in 0.359s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0e9480e9-d3d6-44b3-bb0b-99056a599613 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503.fb1aa5a3-1784-41ab-a1a0-f4351b16304f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:54 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503.fb1aa5a3-1784-41ab-a1a0-f4351b16304f Nov 06 14:46:54 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:54 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c4412f0d-23a5-4248-b595-4a5f45250c2c tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-61c58fae-0af8-46cd-b8d8-65eba8638cf1" returned: 0 in 0.251s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:54 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c4412f0d-23a5-4248-b595-4a5f45250c2c tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-61c58fae-0af8-46cd-b8d8-65eba8638cf1" released by "delete_volume" :: held 0.668s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:54 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-c4412f0d-23a5-4248-b595-4a5f45250c2c tempest-ProjectMemberTests-1693853425 None] Created reservations ['fdffa1d9-3443-400d-b8c2-2870dfa6fd0b', 'ada99c19-5429-4ccc-990c-db6a0d74ee12', 'e3e118c7-9471-41d7-9e7e-69697a5e742c', 'ac0ba706-d32a-4c45-a42b-c84e4c5da395'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c4412f0d-23a5-4248-b595-4a5f45250c2c tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c4412f0d-23a5-4248-b595-4a5f45250c2c tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c4412f0d-23a5-4248-b595-4a5f45250c2c tempest-ProjectMemberTests-1693853425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:54 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-c4412f0d-23a5-4248-b595-4a5f45250c2c tempest-ProjectMemberTests-1693853425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c4412f0d-23a5-4248-b595-4a5f45250c2c tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c4412f0d-23a5-4248-b595-4a5f45250c2c tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:54 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:46:54 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:54 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0e9480e9-d3d6-44b3-bb0b-99056a599613 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503.fb1aa5a3-1784-41ab-a1a0-f4351b16304f" returned: 0 in 0.364s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:54 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0e9480e9-d3d6-44b3-bb0b-99056a599613 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503.fb1aa5a3-1784-41ab-a1a0-f4351b16304f {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:54 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503.fb1aa5a3-1784-41ab-a1a0-f4351b16304f Nov 06 14:46:54 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:55 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c4412f0d-23a5-4248-b595-4a5f45250c2c tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.261s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-c4412f0d-23a5-4248-b595-4a5f45250c2c tempest-ProjectMemberTests-1693853425 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:46:55 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-c4412f0d-23a5-4248-b595-4a5f45250c2c tempest-ProjectMemberTests-1693853425 None] Deleted volume successfully. Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-c4412f0d-23a5-4248-b595-4a5f45250c2c tempest-ProjectMemberTests-1693853425 None] Lock "cinder-61c58fae-0af8-46cd-b8d8-65eba8638cf1-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:55 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0e9480e9-d3d6-44b3-bb0b-99056a599613 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503.fb1aa5a3-1784-41ab-a1a0-f4351b16304f" returned: 0 in 0.267s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-0e9480e9-d3d6-44b3-bb0b-99056a599613 tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-fb1aa5a3-1784-41ab-a1a0-f4351b16304f" released by "_delete_snapshot" :: held 1.458s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-0e9480e9-d3d6-44b3-bb0b-99056a599613 tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-1b0db861-ed59-4b1b-a2ed-ef131de8b503" released by "delete_snapshot" :: held 1.480s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-0e9480e9-d3d6-44b3-bb0b-99056a599613 tempest-ProjectReaderTests-1181373823 None] Created reservations ['3cd5e94b-169a-4478-9b78-4e8065041a84', 'd4cda3bc-7cef-4e13-8f99-8c5e197d2b67', '008c7c8f-9345-47ec-9d89-1abd7316b5f6', 'f994d16b-e931-4dd7-b755-1b39ecc2e2d7'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:55 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-0e9480e9-d3d6-44b3-bb0b-99056a599613 tempest-ProjectReaderTests-1181373823 None] Delete snapshot completed successfully. Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-0e9480e9-d3d6-44b3-bb0b-99056a599613 tempest-ProjectReaderTests-1181373823 None] Lock "cinder-fb1aa5a3-1784-41ab-a1a0-f4351b16304f-delete_snapshot" released by "delete_snapshot" :: held 1.616s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Flow 'volume_create_manager' (9ebedc01-ea82-4777-9a1d-f8e3309c283e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc63f66b-4586-43ab-95ca-cc4c8db3fd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc63f66b-4586-43ab-95ca-cc4c8db3fd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-772302395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07cfc6a9-6ce1-4b74-86b6-b969d82a05f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='babad70bf4064f0c988ad5aee77822ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:56Z,use_quota=True,user_id='874776ea9ab343e5a2850727553c4735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3cfa77-4056-44c1-af39-09008361bfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3cfa77-4056-44c1-af39-09008361bfcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dcaf458-c42f-4fb4-b038-2fc2eb02b9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dcaf458-c42f-4fb4-b038-2fc2eb02b9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07cfc6a9-6ce1-4b74-86b6-b969d82a05f5', 'volume_name': 'volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cdda91b-3f34-472b-8f11-19c117a155a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cdda91b-3f34-472b-8f11-19c117a155a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1e3a2f-97fc-4520-875f-41892541d8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:55 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Volume 07cfc6a9-6ce1-4b74-86b6-b969d82a05f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5', 'volume_size': 1} Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-772302395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07cfc6a9-6ce1-4b74-86b6-b969d82a05f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='babad70bf4064f0c988ad5aee77822ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:56Z,use_quota=True,user_id='874776ea9ab343e5a2850727553c4735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Creating volume 07cfc6a9-6ce1-4b74-86b6-b969d82a05f5 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:46:55 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:55 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5 1073741824 Nov 06 14:46:55 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-52c54ef0-ba15-4488-98e5-44231d4e8899 tempest-ProjectReaderTests-1181373823 None] Acquiring lock "cinder-1b0db861-ed59-4b1b-a2ed-ef131de8b503-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-52c54ef0-ba15-4488-98e5-44231d4e8899 tempest-ProjectReaderTests-1181373823 None] Lock "cinder-1b0db861-ed59-4b1b-a2ed-ef131de8b503-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-52c54ef0-ba15-4488-98e5-44231d4e8899 tempest-ProjectReaderTests-1181373823 None] Acquiring lock "cinder-quobyte-1b0db861-ed59-4b1b-a2ed-ef131de8b503" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:55 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-52c54ef0-ba15-4488-98e5-44231d4e8899 tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-1b0db861-ed59-4b1b-a2ed-ef131de8b503" acquired by "delete_volume" :: waited 0.016s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:56 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[77088326-a4de-4719-86c6-8a5053924b33]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-52c54ef0-ba15-4488-98e5-44231d4e8899 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:56 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503 Nov 06 14:46:56 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:56 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5 1073741824" returned: 0 in 0.456s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:56 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5 Nov 06 14:46:56 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:56 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-52c54ef0-ba15-4488-98e5-44231d4e8899 tempest-ProjectReaderTests-1181373823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503" returned: 0 in 0.374s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-52c54ef0-ba15-4488-98e5-44231d4e8899 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:56 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503 Nov 06 14:46:56 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:56 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5" returned: 0 in 0.258s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:56 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:46:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1e3a2f-97fc-4520-875f-41892541d8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38318c28-9058-4336-bd72-a76e6840ebb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:56 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Volume volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5 (07cfc6a9-6ce1-4b74-86b6-b969d82a05f5): created successfully Nov 06 14:46:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38318c28-9058-4336-bd72-a76e6840ebb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:56 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Flow 'volume_create_manager' (9ebedc01-ea82-4777-9a1d-f8e3309c283e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:56 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-b32b4d17-7f09-4b2b-8866-51a7ec2f6796 tempest-ProjectMemberTests-1693853425 None] Created volume successfully. Nov 06 14:46:56 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-52c54ef0-ba15-4488-98e5-44231d4e8899 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-1b0db861-ed59-4b1b-a2ed-ef131de8b503" returned: 0 in 0.253s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:56 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-52c54ef0-ba15-4488-98e5-44231d4e8899 tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-1b0db861-ed59-4b1b-a2ed-ef131de8b503" released by "delete_volume" :: held 0.695s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:56 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-52c54ef0-ba15-4488-98e5-44231d4e8899 tempest-ProjectReaderTests-1181373823 None] Created reservations ['4881a712-dfb3-40ea-aad6-8338b146dd3b', 'e9be6c14-2c81-4bd6-b526-17215a4a6e49', 'db50a5fc-b096-4b58-b70b-a1542d447c4e', '6e843739-58c1-4a81-9dd7-7222a8164260'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:46:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e74694dc-4f56-40b9-aba0-34609ecf565b tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e74694dc-4f56-40b9-aba0-34609ecf565b tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-52c54ef0-ba15-4488-98e5-44231d4e8899 tempest-ProjectReaderTests-1181373823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-52c54ef0-ba15-4488-98e5-44231d4e8899 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:56 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-52c54ef0-ba15-4488-98e5-44231d4e8899 tempest-ProjectReaderTests-1181373823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:56 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-52c54ef0-ba15-4488-98e5-44231d4e8899 tempest-ProjectReaderTests-1181373823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-52c54ef0-ba15-4488-98e5-44231d4e8899 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-52c54ef0-ba15-4488-98e5-44231d4e8899 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:56 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-e74694dc-4f56-40b9-aba0-34609ecf565b tempest-ProjectMemberTests-1693853425 None] Creating offline snapshot 27924c39-fd62-4abc-aeca-30252b68e0a0 of volume 07cfc6a9-6ce1-4b74-86b6-b969d82a05f5 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:46:56 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:46:56 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:56 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2d1b30-d2e9-4c56-9b10-7b12a3e1a2fb]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:56 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e74694dc-4f56-40b9-aba0-34609ecf565b tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:56 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5 Nov 06 14:46:56 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:57 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-52c54ef0-ba15-4488-98e5-44231d4e8899 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.269s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:57 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-52c54ef0-ba15-4488-98e5-44231d4e8899 tempest-ProjectReaderTests-1181373823 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:46:57 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-52c54ef0-ba15-4488-98e5-44231d4e8899 tempest-ProjectReaderTests-1181373823 None] Deleted volume successfully. Nov 06 14:46:57 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-52c54ef0-ba15-4488-98e5-44231d4e8899 tempest-ProjectReaderTests-1181373823 None] Lock "cinder-1b0db861-ed59-4b1b-a2ed-ef131de8b503-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:46:57 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e74694dc-4f56-40b9-aba0-34609ecf565b tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5" returned: 0 in 0.404s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e74694dc-4f56-40b9-aba0-34609ecf565b tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5.27924c39-fd62-4abc-aeca-30252b68e0a0 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:57 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5.27924c39-fd62-4abc-aeca-30252b68e0a0 1G Nov 06 14:46:57 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:57 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:46:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Flow 'volume_create_manager' (6dc741f6-a7af-41cb-a92a-03494d928cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (153bb864-a13d-40a2-abbb-d26394ea7a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (153bb864-a13d-40a2-abbb-d26394ea7a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-463694380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c765b80c-660a-496e-a0b7-4c881cba5f72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f90f94b028bb4f3d866fc4b4ef171818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:58Z,use_quota=True,user_id='6b0a7a9d8c014b02a857c1931fd0d85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a9b76c-431c-4f4a-bdd5-c2a802ac0e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a9b76c-431c-4f4a-bdd5-c2a802ac0e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80edf336-3c71-47f2-a2fc-58611b4b1072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80edf336-3c71-47f2-a2fc-58611b4b1072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c765b80c-660a-496e-a0b7-4c881cba5f72', 'volume_name': 'volume-c765b80c-660a-496e-a0b7-4c881cba5f72', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b3cbe60-6293-4f36-b49a-aec4aea1ed2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b3cbe60-6293-4f36-b49a-aec4aea1ed2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:57 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e055f26-125c-46db-b39c-b4e2a1a22211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:57 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Volume c765b80c-660a-496e-a0b7-4c881cba5f72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c765b80c-660a-496e-a0b7-4c881cba5f72', 'volume_size': 1} Nov 06 14:46:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:57 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e74694dc-4f56-40b9-aba0-34609ecf565b tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5.27924c39-fd62-4abc-aeca-30252b68e0a0 1G" returned: 0 in 0.422s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e74694dc-4f56-40b9-aba0-34609ecf565b tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5.27924c39-fd62-4abc-aeca-30252b68e0a0 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:57 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5.27924c39-fd62-4abc-aeca-30252b68e0a0 Nov 06 14:46:57 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:57 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e74694dc-4f56-40b9-aba0-34609ecf565b tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5.27924c39-fd62-4abc-aeca-30252b68e0a0" returned: 0 in 0.291s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:57 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-e74694dc-4f56-40b9-aba0-34609ecf565b tempest-ProjectMemberTests-1693853425 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5.27924c39-fd62-4abc-aeca-30252b68e0a0 is being set with open permissions: ugo+rw Nov 06 14:46:57 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e74694dc-4f56-40b9-aba0-34609ecf565b tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5.27924c39-fd62-4abc-aeca-30252b68e0a0 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:58 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5.27924c39-fd62-4abc-aeca-30252b68e0a0 Nov 06 14:46:58 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:58 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e74694dc-4f56-40b9-aba0-34609ecf565b tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5.27924c39-fd62-4abc-aeca-30252b68e0a0" returned: 0 in 0.246s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e74694dc-4f56-40b9-aba0-34609ecf565b tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:58 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5.info Nov 06 14:46:58 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:58 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e74694dc-4f56-40b9-aba0-34609ecf565b tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5.info" returned: 0 in 0.256s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:58 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-e74694dc-4f56-40b9-aba0-34609ecf565b tempest-ProjectMemberTests-1693853425 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5.info is being set with open permissions: ugo+rw Nov 06 14:46:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e74694dc-4f56-40b9-aba0-34609ecf565b tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:58 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5.info Nov 06 14:46:58 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:58 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e74694dc-4f56-40b9-aba0-34609ecf565b tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5.info" returned: 0 in 0.242s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e74694dc-4f56-40b9-aba0-34609ecf565b tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.976s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.104s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-463694380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c765b80c-660a-496e-a0b7-4c881cba5f72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f90f94b028bb4f3d866fc4b4ef171818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:46:58Z,use_quota=True,user_id='6b0a7a9d8c014b02a857c1931fd0d85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:46:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Creating volume c765b80c-660a-496e-a0b7-4c881cba5f72 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:46:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:46:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:46:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:58 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:46:58 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:46:58 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:58 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72 1073741824 Nov 06 14:46:58 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:58 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-e74694dc-4f56-40b9-aba0-34609ecf565b tempest-ProjectMemberTests-1693853425 None] Create snapshot completed successfully Nov 06 14:46:59 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72 1073741824" returned: 0 in 0.408s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:59 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72 Nov 06 14:46:59 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:59 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Nov 06 14:46:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72" returned: 0 in 0.240s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:46:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:46:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:46:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e055f26-125c-46db-b39c-b4e2a1a22211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c765b80c-660a-496e-a0b7-4c881cba5f72', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcb4776e-a8d2-44df-98f2-68e263e4c208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:46:59 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Volume volume-c765b80c-660a-496e-a0b7-4c881cba5f72 (c765b80c-660a-496e-a0b7-4c881cba5f72): created successfully Nov 06 14:46:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcb4776e-a8d2-44df-98f2-68e263e4c208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:46:59 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Flow 'volume_create_manager' (6dc741f6-a7af-41cb-a92a-03494d928cd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:46:59 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-f0d3d26a-571b-4603-bc0f-7f0afbd93933 tempest-ProjectReaderTests-1181373823 None] Created volume successfully. Nov 06 14:46:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ff6e07bd-04fe-4745-8fee-4be4f08f0a19 tempest-ProjectReaderTests-1181373823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:46:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ff6e07bd-04fe-4745-8fee-4be4f08f0a19 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:46:59 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-ff6e07bd-04fe-4745-8fee-4be4f08f0a19 tempest-ProjectReaderTests-1181373823 None] Creating offline snapshot 34723e24-060b-4b0e-9f5d-5d2ef3bd2047 of volume c765b80c-660a-496e-a0b7-4c881cba5f72 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:46:59 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0ee86d-f52d-4823-b570-d00c253ec2b0]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:46:59 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ff6e07bd-04fe-4745-8fee-4be4f08f0a19 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:46:59 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72 Nov 06 14:46:59 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:46:59 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a512ff1c-db2e-4042-b3f0-8fedacd439f9 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-27924c39-fd62-4abc-aeca-30252b68e0a0-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:46:59 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a512ff1c-db2e-4042-b3f0-8fedacd439f9 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-27924c39-fd62-4abc-aeca-30252b68e0a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:46:59 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a512ff1c-db2e-4042-b3f0-8fedacd439f9 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-quobyte-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a512ff1c-db2e-4042-b3f0-8fedacd439f9 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a512ff1c-db2e-4042-b3f0-8fedacd439f9 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-quobyte-27924c39-fd62-4abc-aeca-30252b68e0a0" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:00 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a512ff1c-db2e-4042-b3f0-8fedacd439f9 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-27924c39-fd62-4abc-aeca-30252b68e0a0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-a512ff1c-db2e-4042-b3f0-8fedacd439f9 tempest-ProjectMemberTests-1693853425 None] Deleting offline snapshot 27924c39-fd62-4abc-aeca-30252b68e0a0 of volume 07cfc6a9-6ce1-4b74-86b6-b969d82a05f5 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:47:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-a512ff1c-db2e-4042-b3f0-8fedacd439f9 tempest-ProjectMemberTests-1693853425 None] snapshot_file for this snap is: volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5.27924c39-fd62-4abc-aeca-30252b68e0a0 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:47:00 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d04efe5-bedc-42be-ad59-3ed84e9a7d0a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a512ff1c-db2e-4042-b3f0-8fedacd439f9 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5.27924c39-fd62-4abc-aeca-30252b68e0a0 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:00 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5.27924c39-fd62-4abc-aeca-30252b68e0a0 Nov 06 14:47:00 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:00 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ff6e07bd-04fe-4745-8fee-4be4f08f0a19 tempest-ProjectReaderTests-1181373823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72" returned: 0 in 0.365s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ff6e07bd-04fe-4745-8fee-4be4f08f0a19 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72.34723e24-060b-4b0e-9f5d-5d2ef3bd2047 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:00 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72.34723e24-060b-4b0e-9f5d-5d2ef3bd2047 1G Nov 06 14:47:00 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:00 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a512ff1c-db2e-4042-b3f0-8fedacd439f9 tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5.27924c39-fd62-4abc-aeca-30252b68e0a0" returned: 0 in 0.385s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:00 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-a512ff1c-db2e-4042-b3f0-8fedacd439f9 tempest-ProjectMemberTests-1693853425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:47:00 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7f1518-4d73-49d7-950f-ad8d54c34582]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a512ff1c-db2e-4042-b3f0-8fedacd439f9 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:00 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ff6e07bd-04fe-4745-8fee-4be4f08f0a19 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72.34723e24-060b-4b0e-9f5d-5d2ef3bd2047 1G" returned: 0 in 0.407s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ff6e07bd-04fe-4745-8fee-4be4f08f0a19 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c765b80c-660a-496e-a0b7-4c881cba5f72 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72.34723e24-060b-4b0e-9f5d-5d2ef3bd2047 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:00 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5 Nov 06 14:47:00 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:00 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c765b80c-660a-496e-a0b7-4c881cba5f72 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72.34723e24-060b-4b0e-9f5d-5d2ef3bd2047 Nov 06 14:47:00 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:00 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ff6e07bd-04fe-4745-8fee-4be4f08f0a19 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c765b80c-660a-496e-a0b7-4c881cba5f72 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72.34723e24-060b-4b0e-9f5d-5d2ef3bd2047" returned: 0 in 0.298s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:00 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-ff6e07bd-04fe-4745-8fee-4be4f08f0a19 tempest-ProjectReaderTests-1181373823 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72.34723e24-060b-4b0e-9f5d-5d2ef3bd2047 is being set with open permissions: ugo+rw Nov 06 14:47:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ff6e07bd-04fe-4745-8fee-4be4f08f0a19 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72.34723e24-060b-4b0e-9f5d-5d2ef3bd2047 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:00 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a512ff1c-db2e-4042-b3f0-8fedacd439f9 tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5" returned: 0 in 0.424s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:00 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a512ff1c-db2e-4042-b3f0-8fedacd439f9 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5.27924c39-fd62-4abc-aeca-30252b68e0a0 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:00 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72.34723e24-060b-4b0e-9f5d-5d2ef3bd2047 Nov 06 14:47:00 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:00 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5.27924c39-fd62-4abc-aeca-30252b68e0a0 Nov 06 14:47:00 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:01 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ff6e07bd-04fe-4745-8fee-4be4f08f0a19 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72.34723e24-060b-4b0e-9f5d-5d2ef3bd2047" returned: 0 in 0.258s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ff6e07bd-04fe-4745-8fee-4be4f08f0a19 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:01 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72.info Nov 06 14:47:01 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:01 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a512ff1c-db2e-4042-b3f0-8fedacd439f9 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5.27924c39-fd62-4abc-aeca-30252b68e0a0" returned: 0 in 0.386s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a512ff1c-db2e-4042-b3f0-8fedacd439f9 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5.27924c39-fd62-4abc-aeca-30252b68e0a0 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:01 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5.27924c39-fd62-4abc-aeca-30252b68e0a0 Nov 06 14:47:01 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:01 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ff6e07bd-04fe-4745-8fee-4be4f08f0a19 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72.info" returned: 0 in 0.257s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:01 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-ff6e07bd-04fe-4745-8fee-4be4f08f0a19 tempest-ProjectReaderTests-1181373823 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72.info is being set with open permissions: ugo+rw Nov 06 14:47:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ff6e07bd-04fe-4745-8fee-4be4f08f0a19 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:01 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72.info Nov 06 14:47:01 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:01 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a512ff1c-db2e-4042-b3f0-8fedacd439f9 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5.27924c39-fd62-4abc-aeca-30252b68e0a0" returned: 0 in 0.264s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a512ff1c-db2e-4042-b3f0-8fedacd439f9 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-27924c39-fd62-4abc-aeca-30252b68e0a0" released by "_delete_snapshot" :: held 1.564s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a512ff1c-db2e-4042-b3f0-8fedacd439f9 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5" released by "delete_snapshot" :: held 1.589s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:01 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-a512ff1c-db2e-4042-b3f0-8fedacd439f9 tempest-ProjectMemberTests-1693853425 None] Created reservations ['b72ae80f-87e9-4333-b8f6-621549544cff', 'f7226bca-fdf6-4137-b89a-df56f8b7eabe', '5649e121-a74b-46e7-ac4c-3ad7432a9228', '806d358d-557d-4ca1-80cb-e39b54795574'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:47:01 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ff6e07bd-04fe-4745-8fee-4be4f08f0a19 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72.info" returned: 0 in 0.256s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ff6e07bd-04fe-4745-8fee-4be4f08f0a19 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.919s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:01 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-ff6e07bd-04fe-4745-8fee-4be4f08f0a19 tempest-ProjectReaderTests-1181373823 None] Create snapshot completed successfully Nov 06 14:47:01 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-a512ff1c-db2e-4042-b3f0-8fedacd439f9 tempest-ProjectMemberTests-1693853425 None] Delete snapshot completed successfully. Nov 06 14:47:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-a512ff1c-db2e-4042-b3f0-8fedacd439f9 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-27924c39-fd62-4abc-aeca-30252b68e0a0-delete_snapshot" released by "delete_snapshot" :: held 1.766s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bcfd8ea9-e4af-433d-8e68-d3a2f358e90f tempest-ProjectReaderTests-1181373823 None] Acquiring lock "cinder-34723e24-060b-4b0e-9f5d-5d2ef3bd2047-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bcfd8ea9-e4af-433d-8e68-d3a2f358e90f tempest-ProjectReaderTests-1181373823 None] Lock "cinder-34723e24-060b-4b0e-9f5d-5d2ef3bd2047-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bcfd8ea9-e4af-433d-8e68-d3a2f358e90f tempest-ProjectReaderTests-1181373823 None] Acquiring lock "cinder-quobyte-c765b80c-660a-496e-a0b7-4c881cba5f72" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bcfd8ea9-e4af-433d-8e68-d3a2f358e90f tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-c765b80c-660a-496e-a0b7-4c881cba5f72" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bcfd8ea9-e4af-433d-8e68-d3a2f358e90f tempest-ProjectReaderTests-1181373823 None] Acquiring lock "cinder-quobyte-34723e24-060b-4b0e-9f5d-5d2ef3bd2047" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:01 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bcfd8ea9-e4af-433d-8e68-d3a2f358e90f tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-34723e24-060b-4b0e-9f5d-5d2ef3bd2047" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:01 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-bcfd8ea9-e4af-433d-8e68-d3a2f358e90f tempest-ProjectReaderTests-1181373823 None] Deleting offline snapshot 34723e24-060b-4b0e-9f5d-5d2ef3bd2047 of volume c765b80c-660a-496e-a0b7-4c881cba5f72 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:47:01 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-bcfd8ea9-e4af-433d-8e68-d3a2f358e90f tempest-ProjectReaderTests-1181373823 None] snapshot_file for this snap is: volume-c765b80c-660a-496e-a0b7-4c881cba5f72.34723e24-060b-4b0e-9f5d-5d2ef3bd2047 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:47:01 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec9f623-f509-48de-be1a-ec9d91cd6622]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:01 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bcfd8ea9-e4af-433d-8e68-d3a2f358e90f tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72.34723e24-060b-4b0e-9f5d-5d2ef3bd2047 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:02 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72.34723e24-060b-4b0e-9f5d-5d2ef3bd2047 Nov 06 14:47:02 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:02 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3db3e34c-90a1-400a-a45a-c1746d581e00 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:02 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3db3e34c-90a1-400a-a45a-c1746d581e00 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:02 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3db3e34c-90a1-400a-a45a-c1746d581e00 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-quobyte-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:02 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3db3e34c-90a1-400a-a45a-c1746d581e00 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5" acquired by "delete_volume" :: waited 0.016s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:02 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[20044880-a052-4ffa-8f83-d510d8a2189c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3db3e34c-90a1-400a-a45a-c1746d581e00 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:02 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5 Nov 06 14:47:02 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:02 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bcfd8ea9-e4af-433d-8e68-d3a2f358e90f tempest-ProjectReaderTests-1181373823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72.34723e24-060b-4b0e-9f5d-5d2ef3bd2047" returned: 0 in 0.402s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:02 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-bcfd8ea9-e4af-433d-8e68-d3a2f358e90f tempest-ProjectReaderTests-1181373823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c765b80c-660a-496e-a0b7-4c881cba5f72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:47:02 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba6f2dd-0ac7-4212-9b30-7afa472f12bb]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bcfd8ea9-e4af-433d-8e68-d3a2f358e90f tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:02 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72 Nov 06 14:47:02 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:02 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3db3e34c-90a1-400a-a45a-c1746d581e00 tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5" returned: 0 in 0.381s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3db3e34c-90a1-400a-a45a-c1746d581e00 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:02 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5 Nov 06 14:47:02 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:02 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bcfd8ea9-e4af-433d-8e68-d3a2f358e90f tempest-ProjectReaderTests-1181373823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72" returned: 0 in 0.372s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bcfd8ea9-e4af-433d-8e68-d3a2f358e90f tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72.34723e24-060b-4b0e-9f5d-5d2ef3bd2047 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:02 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72.34723e24-060b-4b0e-9f5d-5d2ef3bd2047 Nov 06 14:47:02 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:02 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:02 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3db3e34c-90a1-400a-a45a-c1746d581e00 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5" returned: 0 in 0.260s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:02 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3db3e34c-90a1-400a-a45a-c1746d581e00 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5" released by "delete_volume" :: held 0.721s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:02 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-3db3e34c-90a1-400a-a45a-c1746d581e00 tempest-ProjectMemberTests-1693853425 None] Created reservations ['1c8a3806-eb12-4e67-8056-a4171f55cc8c', '8c028a3d-6e5b-4bd3-84ba-02ac18c1021d', 'd0d46bee-b148-4241-be72-0c09085c3033', '1f4a2da1-37e0-4218-85e8-c62ff2580c2b'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3db3e34c-90a1-400a-a45a-c1746d581e00 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3db3e34c-90a1-400a-a45a-c1746d581e00 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3db3e34c-90a1-400a-a45a-c1746d581e00 tempest-ProjectMemberTests-1693853425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3db3e34c-90a1-400a-a45a-c1746d581e00 tempest-ProjectMemberTests-1693853425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3db3e34c-90a1-400a-a45a-c1746d581e00 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3db3e34c-90a1-400a-a45a-c1746d581e00 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:03 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:47:03 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:03 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bcfd8ea9-e4af-433d-8e68-d3a2f358e90f tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72.34723e24-060b-4b0e-9f5d-5d2ef3bd2047" returned: 0 in 0.381s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bcfd8ea9-e4af-433d-8e68-d3a2f358e90f tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72.34723e24-060b-4b0e-9f5d-5d2ef3bd2047 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:03 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72.34723e24-060b-4b0e-9f5d-5d2ef3bd2047 Nov 06 14:47:03 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:03 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3db3e34c-90a1-400a-a45a-c1746d581e00 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.275s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-3db3e34c-90a1-400a-a45a-c1746d581e00 tempest-ProjectMemberTests-1693853425 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:47:03 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-3db3e34c-90a1-400a-a45a-c1746d581e00 tempest-ProjectMemberTests-1693853425 None] Deleted volume successfully. Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3db3e34c-90a1-400a-a45a-c1746d581e00 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-07cfc6a9-6ce1-4b74-86b6-b969d82a05f5-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:03 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bcfd8ea9-e4af-433d-8e68-d3a2f358e90f tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72.34723e24-060b-4b0e-9f5d-5d2ef3bd2047" returned: 0 in 0.282s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bcfd8ea9-e4af-433d-8e68-d3a2f358e90f tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-34723e24-060b-4b0e-9f5d-5d2ef3bd2047" released by "_delete_snapshot" :: held 1.535s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bcfd8ea9-e4af-433d-8e68-d3a2f358e90f tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-c765b80c-660a-496e-a0b7-4c881cba5f72" released by "delete_snapshot" :: held 1.560s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-bcfd8ea9-e4af-433d-8e68-d3a2f358e90f tempest-ProjectReaderTests-1181373823 None] Created reservations ['8f88f769-fd37-4051-8e51-fb49d9ff5083', '584b47a7-6ee0-4277-aa75-c22c89dd80d5', '43016ebc-aae4-4cec-9f20-048405290dcf', '679d6318-3c87-4e03-bcc0-8cc7eda5834b'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:47:03 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-bcfd8ea9-e4af-433d-8e68-d3a2f358e90f tempest-ProjectReaderTests-1181373823 None] Delete snapshot completed successfully. Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bcfd8ea9-e4af-433d-8e68-d3a2f358e90f tempest-ProjectReaderTests-1181373823 None] Lock "cinder-34723e24-060b-4b0e-9f5d-5d2ef3bd2047-delete_snapshot" released by "delete_snapshot" :: held 1.720s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Flow 'volume_create_manager' (2e62dcde-8a69-487e-8eae-bb7b8e39e366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dcc1b03-9355-406c-b54f-b7a441c5d467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dcc1b03-9355-406c-b54f-b7a441c5d467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-256252955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6389c87c-4c01-48f5-aa67-e12aa48e9ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='babad70bf4064f0c988ad5aee77822ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:47:04Z,use_quota=True,user_id='874776ea9ab343e5a2850727553c4735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124af9ba-f0fd-4fb0-8ed1-a565e33d57d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124af9ba-f0fd-4fb0-8ed1-a565e33d57d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a482b1ac-8d00-418b-ae71-9439636a1649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a482b1ac-8d00-418b-ae71-9439636a1649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6389c87c-4c01-48f5-aa67-e12aa48e9ddc', 'volume_name': 'volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648e9593-310b-4c73-acdb-8347c2c2f6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648e9593-310b-4c73-acdb-8347c2c2f6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98eca425-c40a-461c-aa82-e5be73d9f3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:03 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Volume 6389c87c-4c01-48f5-aa67-e12aa48e9ddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc', 'volume_size': 1} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-256252955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6389c87c-4c01-48f5-aa67-e12aa48e9ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='babad70bf4064f0c988ad5aee77822ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:47:04Z,use_quota=True,user_id='874776ea9ab343e5a2850727553c4735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Creating volume 6389c87c-4c01-48f5-aa67-e12aa48e9ddc {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:47:03 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:47:03 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:03 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc 1073741824 Nov 06 14:47:03 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:04 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8090a4a7-d965-4ccd-9011-a8d28eb65bbd tempest-ProjectReaderTests-1181373823 None] Acquiring lock "cinder-c765b80c-660a-496e-a0b7-4c881cba5f72-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:04 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8090a4a7-d965-4ccd-9011-a8d28eb65bbd tempest-ProjectReaderTests-1181373823 None] Lock "cinder-c765b80c-660a-496e-a0b7-4c881cba5f72-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:04 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8090a4a7-d965-4ccd-9011-a8d28eb65bbd tempest-ProjectReaderTests-1181373823 None] Acquiring lock "cinder-quobyte-c765b80c-660a-496e-a0b7-4c881cba5f72" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:04 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8090a4a7-d965-4ccd-9011-a8d28eb65bbd tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-c765b80c-660a-496e-a0b7-4c881cba5f72" acquired by "delete_volume" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:04 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4811441-0e0a-4c05-b29f-704a7e109ec4]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8090a4a7-d965-4ccd-9011-a8d28eb65bbd tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:04 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72 Nov 06 14:47:04 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:04 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc 1073741824" returned: 0 in 0.461s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:04 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc Nov 06 14:47:04 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:04 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8090a4a7-d965-4ccd-9011-a8d28eb65bbd tempest-ProjectReaderTests-1181373823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72" returned: 0 in 0.387s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8090a4a7-d965-4ccd-9011-a8d28eb65bbd tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:04 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72 Nov 06 14:47:04 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:04 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc" returned: 0 in 0.261s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:04 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:47:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98eca425-c40a-461c-aa82-e5be73d9f3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7bb1c5a-0347-4a5c-b9d8-5a10336206de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:04 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Volume volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc (6389c87c-4c01-48f5-aa67-e12aa48e9ddc): created successfully Nov 06 14:47:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7bb1c5a-0347-4a5c-b9d8-5a10336206de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:04 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Flow 'volume_create_manager' (2e62dcde-8a69-487e-8eae-bb7b8e39e366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:47:04 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-a9a8bf57-52c4-4c1c-a06f-6a4af03d43ab tempest-ProjectMemberTests-1693853425 None] Created volume successfully. Nov 06 14:47:04 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8090a4a7-d965-4ccd-9011-a8d28eb65bbd tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-c765b80c-660a-496e-a0b7-4c881cba5f72" returned: 0 in 0.253s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:04 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8090a4a7-d965-4ccd-9011-a8d28eb65bbd tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-c765b80c-660a-496e-a0b7-4c881cba5f72" released by "delete_volume" :: held 0.698s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:04 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-8090a4a7-d965-4ccd-9011-a8d28eb65bbd tempest-ProjectReaderTests-1181373823 None] Created reservations ['8a595719-ce3b-409f-bfec-892236f712d3', '2e800e70-f36e-4fdc-a85e-5340c261cb4b', 'bf533d1e-2a42-4f31-9b3f-ff43a03ba164', '6626b432-fe31-41b3-b295-8fcdefcb021c'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:47:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8090a4a7-d965-4ccd-9011-a8d28eb65bbd tempest-ProjectReaderTests-1181373823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8090a4a7-d965-4ccd-9011-a8d28eb65bbd tempest-ProjectReaderTests-1181373823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:04 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8090a4a7-d965-4ccd-9011-a8d28eb65bbd tempest-ProjectReaderTests-1181373823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:47:04 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-8090a4a7-d965-4ccd-9011-a8d28eb65bbd tempest-ProjectReaderTests-1181373823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:47:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8090a4a7-d965-4ccd-9011-a8d28eb65bbd tempest-ProjectReaderTests-1181373823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:04 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8090a4a7-d965-4ccd-9011-a8d28eb65bbd tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:04 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:47:04 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:05 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8090a4a7-d965-4ccd-9011-a8d28eb65bbd tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.248s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:05 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-8090a4a7-d965-4ccd-9011-a8d28eb65bbd tempest-ProjectReaderTests-1181373823 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:47:05 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-8090a4a7-d965-4ccd-9011-a8d28eb65bbd tempest-ProjectReaderTests-1181373823 None] Deleted volume successfully. Nov 06 14:47:05 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-8090a4a7-d965-4ccd-9011-a8d28eb65bbd tempest-ProjectReaderTests-1181373823 None] Lock "cinder-c765b80c-660a-496e-a0b7-4c881cba5f72-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:05 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:47:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Flow 'volume_create_manager' (4fcab0b9-2abe-48eb-87f8-8fafd6148531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:47:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7074e542-4e97-4b3e-93d1-510ce2b01f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7074e542-4e97-4b3e-93d1-510ce2b01f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1789950097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb81284-79ff-4d94-90c9-021ee65a89cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f90f94b028bb4f3d866fc4b4ef171818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:47:06Z,use_quota=True,user_id='6b0a7a9d8c014b02a857c1931fd0d85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a45c5ec-999b-43b8-a4ef-4b30a1c49e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a45c5ec-999b-43b8-a4ef-4b30a1c49e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b80a0f4-c063-4bcc-80fd-30880b2937f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b80a0f4-c063-4bcc-80fd-30880b2937f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fb81284-79ff-4d94-90c9-021ee65a89cd', 'volume_name': 'volume-8fb81284-79ff-4d94-90c9-021ee65a89cd', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423300cd-6488-4480-911d-59d1d51e79d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423300cd-6488-4480-911d-59d1d51e79d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:05 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f4d8a36-8279-461c-be5b-c7119459bf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:05 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Volume 8fb81284-79ff-4d94-90c9-021ee65a89cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fb81284-79ff-4d94-90c9-021ee65a89cd', 'volume_size': 1} Nov 06 14:47:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1789950097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb81284-79ff-4d94-90c9-021ee65a89cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f90f94b028bb4f3d866fc4b4ef171818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:47:06Z,use_quota=True,user_id='6b0a7a9d8c014b02a857c1931fd0d85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:47:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Creating volume 8fb81284-79ff-4d94-90c9-021ee65a89cd {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:47:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:47:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:47:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:05 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:47:05 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:47:05 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:05 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd 1073741824 Nov 06 14:47:05 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-866435bd-6ae5-4e87-92df-e125613dab8c tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:06 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd 1073741824" returned: 0 in 0.489s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:06 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd Nov 06 14:47:06 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:06 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd" returned: 0 in 0.235s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:47:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-866435bd-6ae5-4e87-92df-e125613dab8c tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.434s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f4d8a36-8279-461c-be5b-c7119459bf35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fb81284-79ff-4d94-90c9-021ee65a89cd', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35cf77e3-5c76-4f47-b9d3-6f307173374c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:06 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-866435bd-6ae5-4e87-92df-e125613dab8c tempest-ProjectMemberTests-1693853425 None] Creating offline snapshot 0b425343-1537-409f-a75b-43b9253bc17d of volume 6389c87c-4c01-48f5-aa67-e12aa48e9ddc {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:47:06 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Volume volume-8fb81284-79ff-4d94-90c9-021ee65a89cd (8fb81284-79ff-4d94-90c9-021ee65a89cd): created successfully Nov 06 14:47:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35cf77e3-5c76-4f47-b9d3-6f307173374c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:06 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Flow 'volume_create_manager' (4fcab0b9-2abe-48eb-87f8-8fafd6148531) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:47:06 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d14327e-559f-4856-a8ce-c1d776f8ce28]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-866435bd-6ae5-4e87-92df-e125613dab8c tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:06 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-5206d924-d8c9-432e-9873-5eb2c8c06399 tempest-ProjectReaderTests-1181373823 None] Created volume successfully. Nov 06 14:47:06 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc Nov 06 14:47:06 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-0bc83c13-feaa-43a5-a9f4-a1d886714d5f tempest-ProjectReaderTests-1181373823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:06 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-866435bd-6ae5-4e87-92df-e125613dab8c tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc" returned: 0 in 0.379s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:06 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-866435bd-6ae5-4e87-92df-e125613dab8c tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc.0b425343-1537-409f-a75b-43b9253bc17d 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:06 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc.0b425343-1537-409f-a75b-43b9253bc17d 1G Nov 06 14:47:06 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:07 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-866435bd-6ae5-4e87-92df-e125613dab8c tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc.0b425343-1537-409f-a75b-43b9253bc17d 1G" returned: 0 in 0.382s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-866435bd-6ae5-4e87-92df-e125613dab8c tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc.0b425343-1537-409f-a75b-43b9253bc17d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:07 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc.0b425343-1537-409f-a75b-43b9253bc17d Nov 06 14:47:07 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:07 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-866435bd-6ae5-4e87-92df-e125613dab8c tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc.0b425343-1537-409f-a75b-43b9253bc17d" returned: 0 in 0.286s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:07 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-866435bd-6ae5-4e87-92df-e125613dab8c tempest-ProjectMemberTests-1693853425 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc.0b425343-1537-409f-a75b-43b9253bc17d is being set with open permissions: ugo+rw Nov 06 14:47:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-866435bd-6ae5-4e87-92df-e125613dab8c tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc.0b425343-1537-409f-a75b-43b9253bc17d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:07 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc.0b425343-1537-409f-a75b-43b9253bc17d Nov 06 14:47:07 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:07 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-866435bd-6ae5-4e87-92df-e125613dab8c tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc.0b425343-1537-409f-a75b-43b9253bc17d" returned: 0 in 0.242s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:07 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-866435bd-6ae5-4e87-92df-e125613dab8c tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:07 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc.info Nov 06 14:47:07 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:08 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-866435bd-6ae5-4e87-92df-e125613dab8c tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc.info" returned: 0 in 0.260s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:08 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-866435bd-6ae5-4e87-92df-e125613dab8c tempest-ProjectMemberTests-1693853425 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc.info is being set with open permissions: ugo+rw Nov 06 14:47:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-866435bd-6ae5-4e87-92df-e125613dab8c tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:08 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc.info Nov 06 14:47:08 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:08 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-866435bd-6ae5-4e87-92df-e125613dab8c tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc.info" returned: 0 in 0.238s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-866435bd-6ae5-4e87-92df-e125613dab8c tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.912s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-0bc83c13-feaa-43a5-a9f4-a1d886714d5f tempest-ProjectReaderTests-1181373823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.593s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:08 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-0bc83c13-feaa-43a5-a9f4-a1d886714d5f tempest-ProjectReaderTests-1181373823 None] Creating offline snapshot cd2c81aa-8f5a-440a-a82e-8d0e8c372705 of volume 8fb81284-79ff-4d94-90c9-021ee65a89cd {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:47:08 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-866435bd-6ae5-4e87-92df-e125613dab8c tempest-ProjectMemberTests-1693853425 None] Create snapshot completed successfully Nov 06 14:47:08 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e849aac-cb98-4e75-9e84-015aff9696ed]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0bc83c13-feaa-43a5-a9f4-a1d886714d5f tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:08 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd Nov 06 14:47:08 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:08 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0bc83c13-feaa-43a5-a9f4-a1d886714d5f tempest-ProjectReaderTests-1181373823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd" returned: 0 in 0.340s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:08 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0bc83c13-feaa-43a5-a9f4-a1d886714d5f tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd.cd2c81aa-8f5a-440a-a82e-8d0e8c372705 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:08 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd.cd2c81aa-8f5a-440a-a82e-8d0e8c372705 1G Nov 06 14:47:08 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:09 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0bc83c13-feaa-43a5-a9f4-a1d886714d5f tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd.cd2c81aa-8f5a-440a-a82e-8d0e8c372705 1G" returned: 0 in 0.396s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0bc83c13-feaa-43a5-a9f4-a1d886714d5f tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fb81284-79ff-4d94-90c9-021ee65a89cd -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd.cd2c81aa-8f5a-440a-a82e-8d0e8c372705 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e4d06141-8aff-4d98-b831-f54bee30696b tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-0b425343-1537-409f-a75b-43b9253bc17d-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:09 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fb81284-79ff-4d94-90c9-021ee65a89cd -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd.cd2c81aa-8f5a-440a-a82e-8d0e8c372705 Nov 06 14:47:09 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e4d06141-8aff-4d98-b831-f54bee30696b tempest-ProjectMemberTests-1693853425 None] Lock "cinder-0b425343-1537-409f-a75b-43b9253bc17d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e4d06141-8aff-4d98-b831-f54bee30696b tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-quobyte-6389c87c-4c01-48f5-aa67-e12aa48e9ddc" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e4d06141-8aff-4d98-b831-f54bee30696b tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-6389c87c-4c01-48f5-aa67-e12aa48e9ddc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e4d06141-8aff-4d98-b831-f54bee30696b tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-quobyte-0b425343-1537-409f-a75b-43b9253bc17d" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:09 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e4d06141-8aff-4d98-b831-f54bee30696b tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-0b425343-1537-409f-a75b-43b9253bc17d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-e4d06141-8aff-4d98-b831-f54bee30696b tempest-ProjectMemberTests-1693853425 None] Deleting offline snapshot 0b425343-1537-409f-a75b-43b9253bc17d of volume 6389c87c-4c01-48f5-aa67-e12aa48e9ddc {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:47:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-e4d06141-8aff-4d98-b831-f54bee30696b tempest-ProjectMemberTests-1693853425 None] snapshot_file for this snap is: volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc.0b425343-1537-409f-a75b-43b9253bc17d {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:47:09 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b19cd2-c71a-4f38-925f-6e694fe145ad]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e4d06141-8aff-4d98-b831-f54bee30696b tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc.0b425343-1537-409f-a75b-43b9253bc17d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:09 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc.0b425343-1537-409f-a75b-43b9253bc17d Nov 06 14:47:09 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:09 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0bc83c13-feaa-43a5-a9f4-a1d886714d5f tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fb81284-79ff-4d94-90c9-021ee65a89cd -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd.cd2c81aa-8f5a-440a-a82e-8d0e8c372705" returned: 0 in 0.305s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:09 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-0bc83c13-feaa-43a5-a9f4-a1d886714d5f tempest-ProjectReaderTests-1181373823 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd.cd2c81aa-8f5a-440a-a82e-8d0e8c372705 is being set with open permissions: ugo+rw Nov 06 14:47:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0bc83c13-feaa-43a5-a9f4-a1d886714d5f tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd.cd2c81aa-8f5a-440a-a82e-8d0e8c372705 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:09 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd.cd2c81aa-8f5a-440a-a82e-8d0e8c372705 Nov 06 14:47:09 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:09 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e4d06141-8aff-4d98-b831-f54bee30696b tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc.0b425343-1537-409f-a75b-43b9253bc17d" returned: 0 in 0.381s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:09 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-e4d06141-8aff-4d98-b831-f54bee30696b tempest-ProjectMemberTests-1693853425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:47:09 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c6171a-9559-4166-8486-fc6687a03d87]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e4d06141-8aff-4d98-b831-f54bee30696b tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:09 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0bc83c13-feaa-43a5-a9f4-a1d886714d5f tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd.cd2c81aa-8f5a-440a-a82e-8d0e8c372705" returned: 0 in 0.257s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:09 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0bc83c13-feaa-43a5-a9f4-a1d886714d5f tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:09 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd.info Nov 06 14:47:09 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:09 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc Nov 06 14:47:09 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:10 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0bc83c13-feaa-43a5-a9f4-a1d886714d5f tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd.info" returned: 0 in 0.254s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:10 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-0bc83c13-feaa-43a5-a9f4-a1d886714d5f tempest-ProjectReaderTests-1181373823 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd.info is being set with open permissions: ugo+rw Nov 06 14:47:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0bc83c13-feaa-43a5-a9f4-a1d886714d5f tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:10 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd.info Nov 06 14:47:10 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:10 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e4d06141-8aff-4d98-b831-f54bee30696b tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc" returned: 0 in 0.379s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e4d06141-8aff-4d98-b831-f54bee30696b tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc.0b425343-1537-409f-a75b-43b9253bc17d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:10 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc.0b425343-1537-409f-a75b-43b9253bc17d Nov 06 14:47:10 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:10 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0bc83c13-feaa-43a5-a9f4-a1d886714d5f tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd.info" returned: 0 in 0.261s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-0bc83c13-feaa-43a5-a9f4-a1d886714d5f tempest-ProjectReaderTests-1181373823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.909s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:10 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-0bc83c13-feaa-43a5-a9f4-a1d886714d5f tempest-ProjectReaderTests-1181373823 None] Create snapshot completed successfully Nov 06 14:47:10 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e4d06141-8aff-4d98-b831-f54bee30696b tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc.0b425343-1537-409f-a75b-43b9253bc17d" returned: 0 in 0.340s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e4d06141-8aff-4d98-b831-f54bee30696b tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc.0b425343-1537-409f-a75b-43b9253bc17d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:10 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc.0b425343-1537-409f-a75b-43b9253bc17d Nov 06 14:47:10 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:10 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:10 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e4d06141-8aff-4d98-b831-f54bee30696b tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc.0b425343-1537-409f-a75b-43b9253bc17d" returned: 0 in 0.244s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:10 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e4d06141-8aff-4d98-b831-f54bee30696b tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-0b425343-1537-409f-a75b-43b9253bc17d" released by "_delete_snapshot" :: held 1.450s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:10 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e4d06141-8aff-4d98-b831-f54bee30696b tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-6389c87c-4c01-48f5-aa67-e12aa48e9ddc" released by "delete_snapshot" :: held 1.472s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:10 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-e4d06141-8aff-4d98-b831-f54bee30696b tempest-ProjectMemberTests-1693853425 None] Created reservations ['1b321220-779f-483e-9889-54019b210e68', '36568023-b49b-4b35-9b8c-f7b0f15d5a1a', '54525457-65b7-4f5d-9e9a-fec7ed94385e', '90ec2847-e8dd-4a0b-ab84-9d9cd64ee27c'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:47:10 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-e4d06141-8aff-4d98-b831-f54bee30696b tempest-ProjectMemberTests-1693853425 None] Delete snapshot completed successfully. Nov 06 14:47:10 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-e4d06141-8aff-4d98-b831-f54bee30696b tempest-ProjectMemberTests-1693853425 None] Lock "cinder-0b425343-1537-409f-a75b-43b9253bc17d-delete_snapshot" released by "delete_snapshot" :: held 1.601s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f3a876b7-7c96-4c00-be72-6d68ec7b9714 tempest-ProjectReaderTests-1181373823 None] Acquiring lock "cinder-cd2c81aa-8f5a-440a-a82e-8d0e8c372705-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f3a876b7-7c96-4c00-be72-6d68ec7b9714 tempest-ProjectReaderTests-1181373823 None] Lock "cinder-cd2c81aa-8f5a-440a-a82e-8d0e8c372705-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f3a876b7-7c96-4c00-be72-6d68ec7b9714 tempest-ProjectReaderTests-1181373823 None] Acquiring lock "cinder-quobyte-8fb81284-79ff-4d94-90c9-021ee65a89cd" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f3a876b7-7c96-4c00-be72-6d68ec7b9714 tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-8fb81284-79ff-4d94-90c9-021ee65a89cd" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f3a876b7-7c96-4c00-be72-6d68ec7b9714 tempest-ProjectReaderTests-1181373823 None] Acquiring lock "cinder-quobyte-cd2c81aa-8f5a-440a-a82e-8d0e8c372705" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f3a876b7-7c96-4c00-be72-6d68ec7b9714 tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-cd2c81aa-8f5a-440a-a82e-8d0e8c372705" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:11 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-f3a876b7-7c96-4c00-be72-6d68ec7b9714 tempest-ProjectReaderTests-1181373823 None] Deleting offline snapshot cd2c81aa-8f5a-440a-a82e-8d0e8c372705 of volume 8fb81284-79ff-4d94-90c9-021ee65a89cd {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:47:11 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-f3a876b7-7c96-4c00-be72-6d68ec7b9714 tempest-ProjectReaderTests-1181373823 None] snapshot_file for this snap is: volume-8fb81284-79ff-4d94-90c9-021ee65a89cd.cd2c81aa-8f5a-440a-a82e-8d0e8c372705 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:47:11 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[82eb09c4-2f7a-44f6-b518-dcdb7b974c70]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f3a876b7-7c96-4c00-be72-6d68ec7b9714 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd.cd2c81aa-8f5a-440a-a82e-8d0e8c372705 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:11 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd.cd2c81aa-8f5a-440a-a82e-8d0e8c372705 Nov 06 14:47:11 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b175d4f9-20d2-421b-be7a-a43d84dd0ba4 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-6389c87c-4c01-48f5-aa67-e12aa48e9ddc-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b175d4f9-20d2-421b-be7a-a43d84dd0ba4 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-6389c87c-4c01-48f5-aa67-e12aa48e9ddc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b175d4f9-20d2-421b-be7a-a43d84dd0ba4 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-quobyte-6389c87c-4c01-48f5-aa67-e12aa48e9ddc" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:11 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b175d4f9-20d2-421b-be7a-a43d84dd0ba4 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-6389c87c-4c01-48f5-aa67-e12aa48e9ddc" acquired by "delete_volume" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:11 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f3a876b7-7c96-4c00-be72-6d68ec7b9714 tempest-ProjectReaderTests-1181373823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd.cd2c81aa-8f5a-440a-a82e-8d0e8c372705" returned: 0 in 0.404s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:11 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-f3a876b7-7c96-4c00-be72-6d68ec7b9714 tempest-ProjectReaderTests-1181373823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fb81284-79ff-4d94-90c9-021ee65a89cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:47:11 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc7b85b-0e83-40ea-9d69-adb573a7ff17]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b175d4f9-20d2-421b-be7a-a43d84dd0ba4 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:11 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[579bc858-6e58-4d7a-afaa-9bf4c274880c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f3a876b7-7c96-4c00-be72-6d68ec7b9714 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:11 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc Nov 06 14:47:11 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:11 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd Nov 06 14:47:11 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:11 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b175d4f9-20d2-421b-be7a-a43d84dd0ba4 tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc" returned: 0 in 0.364s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b175d4f9-20d2-421b-be7a-a43d84dd0ba4 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:11 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc Nov 06 14:47:11 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:11 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f3a876b7-7c96-4c00-be72-6d68ec7b9714 tempest-ProjectReaderTests-1181373823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd" returned: 0 in 0.392s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:11 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f3a876b7-7c96-4c00-be72-6d68ec7b9714 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd.cd2c81aa-8f5a-440a-a82e-8d0e8c372705 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:11 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd.cd2c81aa-8f5a-440a-a82e-8d0e8c372705 Nov 06 14:47:11 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:12 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b175d4f9-20d2-421b-be7a-a43d84dd0ba4 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-6389c87c-4c01-48f5-aa67-e12aa48e9ddc" returned: 0 in 0.284s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:12 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b175d4f9-20d2-421b-be7a-a43d84dd0ba4 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-6389c87c-4c01-48f5-aa67-e12aa48e9ddc" released by "delete_volume" :: held 0.722s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:12 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-b175d4f9-20d2-421b-be7a-a43d84dd0ba4 tempest-ProjectMemberTests-1693853425 None] Created reservations ['c3f33315-deca-4531-a32d-e7c3c6707001', '47fb3598-7008-4b1f-955e-12612f33a9c1', 'e4b9fce4-6326-4779-8a41-a4a572dc7447', '3cc28ed0-8851-4e82-8339-721b59298cc5'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:47:12 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f3a876b7-7c96-4c00-be72-6d68ec7b9714 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd.cd2c81aa-8f5a-440a-a82e-8d0e8c372705" returned: 0 in 0.360s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f3a876b7-7c96-4c00-be72-6d68ec7b9714 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd.cd2c81aa-8f5a-440a-a82e-8d0e8c372705 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:12 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd.cd2c81aa-8f5a-440a-a82e-8d0e8c372705 Nov 06 14:47:12 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b175d4f9-20d2-421b-be7a-a43d84dd0ba4 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b175d4f9-20d2-421b-be7a-a43d84dd0ba4 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:12 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b175d4f9-20d2-421b-be7a-a43d84dd0ba4 tempest-ProjectMemberTests-1693853425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:47:12 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b175d4f9-20d2-421b-be7a-a43d84dd0ba4 tempest-ProjectMemberTests-1693853425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:47:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b175d4f9-20d2-421b-be7a-a43d84dd0ba4 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b175d4f9-20d2-421b-be7a-a43d84dd0ba4 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:12 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:47:12 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:12 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f3a876b7-7c96-4c00-be72-6d68ec7b9714 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd.cd2c81aa-8f5a-440a-a82e-8d0e8c372705" returned: 0 in 0.261s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:12 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:12 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b175d4f9-20d2-421b-be7a-a43d84dd0ba4 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.264s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:12 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-b175d4f9-20d2-421b-be7a-a43d84dd0ba4 tempest-ProjectMemberTests-1693853425 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:47:12 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f3a876b7-7c96-4c00-be72-6d68ec7b9714 tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-cd2c81aa-8f5a-440a-a82e-8d0e8c372705" released by "_delete_snapshot" :: held 1.530s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:12 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-b175d4f9-20d2-421b-be7a-a43d84dd0ba4 tempest-ProjectMemberTests-1693853425 None] Deleted volume successfully. Nov 06 14:47:12 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f3a876b7-7c96-4c00-be72-6d68ec7b9714 tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-8fb81284-79ff-4d94-90c9-021ee65a89cd" released by "delete_snapshot" :: held 1.559s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:12 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b175d4f9-20d2-421b-be7a-a43d84dd0ba4 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-6389c87c-4c01-48f5-aa67-e12aa48e9ddc-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:12 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-f3a876b7-7c96-4c00-be72-6d68ec7b9714 tempest-ProjectReaderTests-1181373823 None] Created reservations ['6dc20cd2-c964-4775-be28-722a15f88e8a', '73af0beb-e23e-4b10-af63-f2c3a8c4da04', '2edad68b-89b4-4b82-b853-6a0403d148ef', 'b448fb93-e70d-4f4d-8be3-426bb6f23a56'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:47:12 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-f3a876b7-7c96-4c00-be72-6d68ec7b9714 tempest-ProjectReaderTests-1181373823 None] Delete snapshot completed successfully. Nov 06 14:47:12 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f3a876b7-7c96-4c00-be72-6d68ec7b9714 tempest-ProjectReaderTests-1181373823 None] Lock "cinder-cd2c81aa-8f5a-440a-a82e-8d0e8c372705-delete_snapshot" released by "delete_snapshot" :: held 1.699s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Flow 'volume_create_manager' (a90d6d6f-a007-4da8-90fa-30775bb3c63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a43907-4e0f-4253-a146-dea74095e2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a43907-4e0f-4253-a146-dea74095e2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-824909394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d6e132-6326-4123-8f2c-32afd34570f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='babad70bf4064f0c988ad5aee77822ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:47:13Z,use_quota=True,user_id='874776ea9ab343e5a2850727553c4735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893d84f5-e76e-4b90-b28c-025098a127a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893d84f5-e76e-4b90-b28c-025098a127a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (395cf229-6477-47e1-b64b-9fb2e26c208f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (395cf229-6477-47e1-b64b-9fb2e26c208f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32d6e132-6326-4123-8f2c-32afd34570f5', 'volume_name': 'volume-32d6e132-6326-4123-8f2c-32afd34570f5', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a0b6cef-7e80-49d8-9d41-f2bbdfda0073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a0b6cef-7e80-49d8-9d41-f2bbdfda0073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec4243a-aadb-4dc0-9012-4e466ad88809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:13 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Volume 32d6e132-6326-4123-8f2c-32afd34570f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32d6e132-6326-4123-8f2c-32afd34570f5', 'volume_size': 1} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-824909394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d6e132-6326-4123-8f2c-32afd34570f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='babad70bf4064f0c988ad5aee77822ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:47:13Z,use_quota=True,user_id='874776ea9ab343e5a2850727553c4735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Creating volume 32d6e132-6326-4123-8f2c-32afd34570f5 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:47:13 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:13 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5 1073741824 Nov 06 14:47:13 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-56582f11-0eed-48f4-9136-a1132fd9750a tempest-ProjectReaderTests-1181373823 None] Acquiring lock "cinder-8fb81284-79ff-4d94-90c9-021ee65a89cd-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-56582f11-0eed-48f4-9136-a1132fd9750a tempest-ProjectReaderTests-1181373823 None] Lock "cinder-8fb81284-79ff-4d94-90c9-021ee65a89cd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-56582f11-0eed-48f4-9136-a1132fd9750a tempest-ProjectReaderTests-1181373823 None] Acquiring lock "cinder-quobyte-8fb81284-79ff-4d94-90c9-021ee65a89cd" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-56582f11-0eed-48f4-9136-a1132fd9750a tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-8fb81284-79ff-4d94-90c9-021ee65a89cd" acquired by "delete_volume" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[800bfa3f-b03e-4d2f-8e3a-81ffee2840c2]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-56582f11-0eed-48f4-9136-a1132fd9750a tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:13 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd Nov 06 14:47:13 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:13 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5 1073741824" returned: 0 in 0.454s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:13 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5 Nov 06 14:47:13 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:13 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-56582f11-0eed-48f4-9136-a1132fd9750a tempest-ProjectReaderTests-1181373823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd" returned: 0 in 0.376s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-56582f11-0eed-48f4-9136-a1132fd9750a tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:13 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd Nov 06 14:47:13 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:13 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5" returned: 0 in 0.246s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec4243a-aadb-4dc0-9012-4e466ad88809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32d6e132-6326-4123-8f2c-32afd34570f5', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6121f57-537e-44bf-9555-c0ca78e6e7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:13 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Volume volume-32d6e132-6326-4123-8f2c-32afd34570f5 (32d6e132-6326-4123-8f2c-32afd34570f5): created successfully Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6121f57-537e-44bf-9555-c0ca78e6e7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Flow 'volume_create_manager' (a90d6d6f-a007-4da8-90fa-30775bb3c63d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:47:13 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-e0669dad-cfa8-4948-a53d-c1449ae5ab05 tempest-ProjectMemberTests-1693853425 None] Created volume successfully. Nov 06 14:47:13 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-56582f11-0eed-48f4-9136-a1132fd9750a tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-8fb81284-79ff-4d94-90c9-021ee65a89cd" returned: 0 in 0.260s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:13 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-56582f11-0eed-48f4-9136-a1132fd9750a tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-8fb81284-79ff-4d94-90c9-021ee65a89cd" released by "delete_volume" :: held 0.699s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-56582f11-0eed-48f4-9136-a1132fd9750a tempest-ProjectReaderTests-1181373823 None] Created reservations ['7e03582f-15f1-4395-8337-aff6c6ffd5ae', '43ec14f5-2e8d-4c86-9127-c5aff906676d', 'a546adab-ae33-419a-88fc-d23df4e0aa30', '5fcfce6f-e31f-40b1-8b80-bd730a38dc46'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-56582f11-0eed-48f4-9136-a1132fd9750a tempest-ProjectReaderTests-1181373823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-56582f11-0eed-48f4-9136-a1132fd9750a tempest-ProjectReaderTests-1181373823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-56582f11-0eed-48f4-9136-a1132fd9750a tempest-ProjectReaderTests-1181373823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-56582f11-0eed-48f4-9136-a1132fd9750a tempest-ProjectReaderTests-1181373823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-56582f11-0eed-48f4-9136-a1132fd9750a tempest-ProjectReaderTests-1181373823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-56582f11-0eed-48f4-9136-a1132fd9750a tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:14 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:47:14 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9630b880-5812-4e33-aeca-8774cc5fa6c3 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9630b880-5812-4e33-aeca-8774cc5fa6c3 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-9630b880-5812-4e33-aeca-8774cc5fa6c3 tempest-ProjectMemberTests-1693853425 None] Creating offline snapshot d778c666-856d-4677-aabb-b57544c9275a of volume 32d6e132-6326-4123-8f2c-32afd34570f5 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f11e860-fc97-461e-8ca3-01021d3af725]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9630b880-5812-4e33-aeca-8774cc5fa6c3 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:14 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-56582f11-0eed-48f4-9136-a1132fd9750a tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.296s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-56582f11-0eed-48f4-9136-a1132fd9750a tempest-ProjectReaderTests-1181373823 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:47:14 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-56582f11-0eed-48f4-9136-a1132fd9750a tempest-ProjectReaderTests-1181373823 None] Deleted volume successfully. Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-56582f11-0eed-48f4-9136-a1132fd9750a tempest-ProjectReaderTests-1181373823 None] Lock "cinder-8fb81284-79ff-4d94-90c9-021ee65a89cd-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:14 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5 Nov 06 14:47:14 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:14 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9630b880-5812-4e33-aeca-8774cc5fa6c3 tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5" returned: 0 in 0.404s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9630b880-5812-4e33-aeca-8774cc5fa6c3 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5.d778c666-856d-4677-aabb-b57544c9275a 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:14 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5.d778c666-856d-4677-aabb-b57544c9275a 1G Nov 06 14:47:14 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Flow 'volume_create_manager' (cff3a5a5-cb85-4ac0-9a65-67b5f83dac29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8439fcef-10ee-49df-a651-95c6d79931c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8439fcef-10ee-49df-a651-95c6d79931c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-322669166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bca6a22-2d64-4052-8cec-d04af71cba0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f90f94b028bb4f3d866fc4b4ef171818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:47:15Z,use_quota=True,user_id='6b0a7a9d8c014b02a857c1931fd0d85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99b6c7c-5662-4f72-94c0-e51f81918e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99b6c7c-5662-4f72-94c0-e51f81918e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b65ce0-3db5-4205-aabf-a012607d3d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b65ce0-3db5-4205-aabf-a012607d3d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bca6a22-2d64-4052-8cec-d04af71cba0d', 'volume_name': 'volume-4bca6a22-2d64-4052-8cec-d04af71cba0d', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a84231-4929-4f4e-9d1a-1830cbc5d3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a84231-4929-4f4e-9d1a-1830cbc5d3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adb66b8b-b1e7-44e6-8858-0570c9c30fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:14 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Volume 4bca6a22-2d64-4052-8cec-d04af71cba0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bca6a22-2d64-4052-8cec-d04af71cba0d', 'volume_size': 1} Nov 06 14:47:14 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:15 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9630b880-5812-4e33-aeca-8774cc5fa6c3 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5.d778c666-856d-4677-aabb-b57544c9275a 1G" returned: 0 in 0.411s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9630b880-5812-4e33-aeca-8774cc5fa6c3 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32d6e132-6326-4123-8f2c-32afd34570f5 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5.d778c666-856d-4677-aabb-b57544c9275a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:15 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32d6e132-6326-4123-8f2c-32afd34570f5 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5.d778c666-856d-4677-aabb-b57544c9275a Nov 06 14:47:15 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:15 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9630b880-5812-4e33-aeca-8774cc5fa6c3 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32d6e132-6326-4123-8f2c-32afd34570f5 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5.d778c666-856d-4677-aabb-b57544c9275a" returned: 0 in 0.287s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:15 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-9630b880-5812-4e33-aeca-8774cc5fa6c3 tempest-ProjectMemberTests-1693853425 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5.d778c666-856d-4677-aabb-b57544c9275a is being set with open permissions: ugo+rw Nov 06 14:47:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9630b880-5812-4e33-aeca-8774cc5fa6c3 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5.d778c666-856d-4677-aabb-b57544c9275a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:15 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5.d778c666-856d-4677-aabb-b57544c9275a Nov 06 14:47:15 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:15 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9630b880-5812-4e33-aeca-8774cc5fa6c3 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5.d778c666-856d-4677-aabb-b57544c9275a" returned: 0 in 0.238s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9630b880-5812-4e33-aeca-8774cc5fa6c3 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:15 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5.info Nov 06 14:47:15 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:15 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9630b880-5812-4e33-aeca-8774cc5fa6c3 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5.info" returned: 0 in 0.249s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:15 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-9630b880-5812-4e33-aeca-8774cc5fa6c3 tempest-ProjectMemberTests-1693853425 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5.info is being set with open permissions: ugo+rw Nov 06 14:47:15 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9630b880-5812-4e33-aeca-8774cc5fa6c3 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:16 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5.info Nov 06 14:47:16 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:16 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9630b880-5812-4e33-aeca-8774cc5fa6c3 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5.info" returned: 0 in 0.257s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9630b880-5812-4e33-aeca-8774cc5fa6c3 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.028s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.327s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-322669166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bca6a22-2d64-4052-8cec-d04af71cba0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f90f94b028bb4f3d866fc4b4ef171818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:47:15Z,use_quota=True,user_id='6b0a7a9d8c014b02a857c1931fd0d85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:47:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Creating volume 4bca6a22-2d64-4052-8cec-d04af71cba0d {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:47:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:47:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:47:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:47:16 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:47:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:16 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d 1073741824 Nov 06 14:47:16 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:16 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-9630b880-5812-4e33-aeca-8774cc5fa6c3 tempest-ProjectMemberTests-1693853425 None] Create snapshot completed successfully Nov 06 14:47:16 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d 1073741824" returned: 0 in 0.421s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:16 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d Nov 06 14:47:16 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:16 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d" returned: 0 in 0.245s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:16 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:47:16 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adb66b8b-b1e7-44e6-8858-0570c9c30fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bca6a22-2d64-4052-8cec-d04af71cba0d', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:16 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (452e9ebb-382a-4501-b6f0-f5020e2a6ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:17 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Volume volume-4bca6a22-2d64-4052-8cec-d04af71cba0d (4bca6a22-2d64-4052-8cec-d04af71cba0d): created successfully Nov 06 14:47:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (452e9ebb-382a-4501-b6f0-f5020e2a6ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Flow 'volume_create_manager' (cff3a5a5-cb85-4ac0-9a65-67b5f83dac29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:47:17 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-a56da4c3-716c-4b77-9f2e-7374010ed5c5 tempest-ProjectReaderTests-1181373823 None] Created volume successfully. Nov 06 14:47:17 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-0e2cf44c-ece5-4898-bc2f-3308e024dc37 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-d778c666-856d-4677-aabb-b57544c9275a-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:17 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-0e2cf44c-ece5-4898-bc2f-3308e024dc37 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-d778c666-856d-4677-aabb-b57544c9275a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:17 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-0e2cf44c-ece5-4898-bc2f-3308e024dc37 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-quobyte-32d6e132-6326-4123-8f2c-32afd34570f5" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:17 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-0e2cf44c-ece5-4898-bc2f-3308e024dc37 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-32d6e132-6326-4123-8f2c-32afd34570f5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:17 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-0e2cf44c-ece5-4898-bc2f-3308e024dc37 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-quobyte-d778c666-856d-4677-aabb-b57544c9275a" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:17 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-0e2cf44c-ece5-4898-bc2f-3308e024dc37 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-d778c666-856d-4677-aabb-b57544c9275a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-0e2cf44c-ece5-4898-bc2f-3308e024dc37 tempest-ProjectMemberTests-1693853425 None] Deleting offline snapshot d778c666-856d-4677-aabb-b57544c9275a of volume 32d6e132-6326-4123-8f2c-32afd34570f5 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:47:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-0e2cf44c-ece5-4898-bc2f-3308e024dc37 tempest-ProjectMemberTests-1693853425 None] snapshot_file for this snap is: volume-32d6e132-6326-4123-8f2c-32afd34570f5.d778c666-856d-4677-aabb-b57544c9275a {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:47:17 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[5053dafa-85e3-4607-ad0c-7cbfaa40d43c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0e2cf44c-ece5-4898-bc2f-3308e024dc37 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5.d778c666-856d-4677-aabb-b57544c9275a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:17 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5.d778c666-856d-4677-aabb-b57544c9275a Nov 06 14:47:17 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:17 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0e2cf44c-ece5-4898-bc2f-3308e024dc37 tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5.d778c666-856d-4677-aabb-b57544c9275a" returned: 0 in 0.356s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-0e2cf44c-ece5-4898-bc2f-3308e024dc37 tempest-ProjectMemberTests-1693853425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32d6e132-6326-4123-8f2c-32afd34570f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:47:17 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[022344b3-56b6-4ed5-ae53-fd2b03014685]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0e2cf44c-ece5-4898-bc2f-3308e024dc37 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:17 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5 Nov 06 14:47:17 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7128b76d-83bc-420c-a119-d426031a38ab tempest-ProjectReaderTests-1181373823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7128b76d-83bc-420c-a119-d426031a38ab tempest-ProjectReaderTests-1181373823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:18 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-7128b76d-83bc-420c-a119-d426031a38ab tempest-ProjectReaderTests-1181373823 None] Creating offline snapshot eda3675f-868f-4f2c-9102-2af92be078c1 of volume 4bca6a22-2d64-4052-8cec-d04af71cba0d {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:47:18 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[61764cd1-a4c2-42b9-bb7a-0a820d0fa096]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7128b76d-83bc-420c-a119-d426031a38ab tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:18 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0e2cf44c-ece5-4898-bc2f-3308e024dc37 tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5" returned: 0 in 0.375s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0e2cf44c-ece5-4898-bc2f-3308e024dc37 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5.d778c666-856d-4677-aabb-b57544c9275a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:18 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5.d778c666-856d-4677-aabb-b57544c9275a Nov 06 14:47:18 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:18 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d Nov 06 14:47:18 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:18 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0e2cf44c-ece5-4898-bc2f-3308e024dc37 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5.d778c666-856d-4677-aabb-b57544c9275a" returned: 0 in 0.325s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0e2cf44c-ece5-4898-bc2f-3308e024dc37 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5.d778c666-856d-4677-aabb-b57544c9275a {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:18 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7128b76d-83bc-420c-a119-d426031a38ab tempest-ProjectReaderTests-1181373823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d" returned: 0 in 0.394s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7128b76d-83bc-420c-a119-d426031a38ab tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d.eda3675f-868f-4f2c-9102-2af92be078c1 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:18 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5.d778c666-856d-4677-aabb-b57544c9275a Nov 06 14:47:18 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:18 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d.eda3675f-868f-4f2c-9102-2af92be078c1 1G Nov 06 14:47:18 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:18 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-0e2cf44c-ece5-4898-bc2f-3308e024dc37 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5.d778c666-856d-4677-aabb-b57544c9275a" returned: 0 in 0.245s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-0e2cf44c-ece5-4898-bc2f-3308e024dc37 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-d778c666-856d-4677-aabb-b57544c9275a" released by "_delete_snapshot" :: held 1.399s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-0e2cf44c-ece5-4898-bc2f-3308e024dc37 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-32d6e132-6326-4123-8f2c-32afd34570f5" released by "delete_snapshot" :: held 1.429s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:18 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-0e2cf44c-ece5-4898-bc2f-3308e024dc37 tempest-ProjectMemberTests-1693853425 None] Created reservations ['76728cbb-dd07-4075-b884-5dcafeab3123', 'f6f44cc3-b7de-4257-a9c1-7738bb22c46b', '725cb6dc-574d-4374-bd40-699be0464e6f', '06ba9bdf-326e-47ba-b94f-e430f735bac5'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:47:18 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-0e2cf44c-ece5-4898-bc2f-3308e024dc37 tempest-ProjectMemberTests-1693853425 None] Delete snapshot completed successfully. Nov 06 14:47:18 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-0e2cf44c-ece5-4898-bc2f-3308e024dc37 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-d778c666-856d-4677-aabb-b57544c9275a-delete_snapshot" released by "delete_snapshot" :: held 1.568s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:18 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7128b76d-83bc-420c-a119-d426031a38ab tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d.eda3675f-868f-4f2c-9102-2af92be078c1 1G" returned: 0 in 0.425s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7128b76d-83bc-420c-a119-d426031a38ab tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bca6a22-2d64-4052-8cec-d04af71cba0d -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d.eda3675f-868f-4f2c-9102-2af92be078c1 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:19 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bca6a22-2d64-4052-8cec-d04af71cba0d -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d.eda3675f-868f-4f2c-9102-2af92be078c1 Nov 06 14:47:19 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:19 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7128b76d-83bc-420c-a119-d426031a38ab tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bca6a22-2d64-4052-8cec-d04af71cba0d -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d.eda3675f-868f-4f2c-9102-2af92be078c1" returned: 0 in 0.286s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:19 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-7128b76d-83bc-420c-a119-d426031a38ab tempest-ProjectReaderTests-1181373823 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d.eda3675f-868f-4f2c-9102-2af92be078c1 is being set with open permissions: ugo+rw Nov 06 14:47:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7128b76d-83bc-420c-a119-d426031a38ab tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d.eda3675f-868f-4f2c-9102-2af92be078c1 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:19 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d.eda3675f-868f-4f2c-9102-2af92be078c1 Nov 06 14:47:19 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:19 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7128b76d-83bc-420c-a119-d426031a38ab tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d.eda3675f-868f-4f2c-9102-2af92be078c1" returned: 0 in 0.241s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4783c9ae-efcc-473b-8487-67f6708cde60 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-32d6e132-6326-4123-8f2c-32afd34570f5-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7128b76d-83bc-420c-a119-d426031a38ab tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4783c9ae-efcc-473b-8487-67f6708cde60 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-32d6e132-6326-4123-8f2c-32afd34570f5-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:19 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d.info Nov 06 14:47:19 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4783c9ae-efcc-473b-8487-67f6708cde60 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-quobyte-32d6e132-6326-4123-8f2c-32afd34570f5" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:19 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4783c9ae-efcc-473b-8487-67f6708cde60 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-32d6e132-6326-4123-8f2c-32afd34570f5" acquired by "delete_volume" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:19 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0582a4c-3f15-420d-bc9a-c044b9dc98ce]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4783c9ae-efcc-473b-8487-67f6708cde60 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:19 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5 Nov 06 14:47:19 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:19 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7128b76d-83bc-420c-a119-d426031a38ab tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d.info" returned: 0 in 0.264s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:19 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-7128b76d-83bc-420c-a119-d426031a38ab tempest-ProjectReaderTests-1181373823 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d.info is being set with open permissions: ugo+rw Nov 06 14:47:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7128b76d-83bc-420c-a119-d426031a38ab tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:19 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d.info Nov 06 14:47:19 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:20 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4783c9ae-efcc-473b-8487-67f6708cde60 tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5" returned: 0 in 0.367s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4783c9ae-efcc-473b-8487-67f6708cde60 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:20 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5 Nov 06 14:47:20 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:20 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-7128b76d-83bc-420c-a119-d426031a38ab tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d.info" returned: 0 in 0.250s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-7128b76d-83bc-420c-a119-d426031a38ab tempest-ProjectReaderTests-1181373823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.962s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:20 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-7128b76d-83bc-420c-a119-d426031a38ab tempest-ProjectReaderTests-1181373823 None] Create snapshot completed successfully Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-54c63f4d-0943-48bc-9ed3-105abdfdd31b tempest-ProjectReaderTests-1181373823 None] Acquiring lock "cinder-eda3675f-868f-4f2c-9102-2af92be078c1-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-54c63f4d-0943-48bc-9ed3-105abdfdd31b tempest-ProjectReaderTests-1181373823 None] Lock "cinder-eda3675f-868f-4f2c-9102-2af92be078c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-54c63f4d-0943-48bc-9ed3-105abdfdd31b tempest-ProjectReaderTests-1181373823 None] Acquiring lock "cinder-quobyte-4bca6a22-2d64-4052-8cec-d04af71cba0d" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-54c63f4d-0943-48bc-9ed3-105abdfdd31b tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-4bca6a22-2d64-4052-8cec-d04af71cba0d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-54c63f4d-0943-48bc-9ed3-105abdfdd31b tempest-ProjectReaderTests-1181373823 None] Acquiring lock "cinder-quobyte-eda3675f-868f-4f2c-9102-2af92be078c1" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-54c63f4d-0943-48bc-9ed3-105abdfdd31b tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-eda3675f-868f-4f2c-9102-2af92be078c1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-54c63f4d-0943-48bc-9ed3-105abdfdd31b tempest-ProjectReaderTests-1181373823 None] Deleting offline snapshot eda3675f-868f-4f2c-9102-2af92be078c1 of volume 4bca6a22-2d64-4052-8cec-d04af71cba0d {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:47:20 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-54c63f4d-0943-48bc-9ed3-105abdfdd31b tempest-ProjectReaderTests-1181373823 None] snapshot_file for this snap is: volume-4bca6a22-2d64-4052-8cec-d04af71cba0d.eda3675f-868f-4f2c-9102-2af92be078c1 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4783c9ae-efcc-473b-8487-67f6708cde60 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-32d6e132-6326-4123-8f2c-32afd34570f5" returned: 0 in 0.283s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f587085-4d3d-42d9-965c-5603c283f67b]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-54c63f4d-0943-48bc-9ed3-105abdfdd31b tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d.eda3675f-868f-4f2c-9102-2af92be078c1 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4783c9ae-efcc-473b-8487-67f6708cde60 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-32d6e132-6326-4123-8f2c-32afd34570f5" released by "delete_volume" :: held 0.727s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-4783c9ae-efcc-473b-8487-67f6708cde60 tempest-ProjectMemberTests-1693853425 None] Created reservations ['d02563ee-525c-4b15-898f-7003fa85626a', '098dcce4-71c0-4e14-8f1c-45590bb51f85', '37037cfe-66d1-46db-997a-690ef477ed45', 'ee3bf158-1522-4430-b3f9-2711ce613ce2'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4783c9ae-efcc-473b-8487-67f6708cde60 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4783c9ae-efcc-473b-8487-67f6708cde60 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:20 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d.eda3675f-868f-4f2c-9102-2af92be078c1 Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4783c9ae-efcc-473b-8487-67f6708cde60 tempest-ProjectMemberTests-1693853425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:47:20 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-4783c9ae-efcc-473b-8487-67f6708cde60 tempest-ProjectMemberTests-1693853425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-4783c9ae-efcc-473b-8487-67f6708cde60 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4783c9ae-efcc-473b-8487-67f6708cde60 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:20 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:47:20 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:20 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:20 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-4783c9ae-efcc-473b-8487-67f6708cde60 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.268s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-4783c9ae-efcc-473b-8487-67f6708cde60 tempest-ProjectMemberTests-1693853425 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-54c63f4d-0943-48bc-9ed3-105abdfdd31b tempest-ProjectReaderTests-1181373823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d.eda3675f-868f-4f2c-9102-2af92be078c1" returned: 0 in 0.396s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-54c63f4d-0943-48bc-9ed3-105abdfdd31b tempest-ProjectReaderTests-1181373823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bca6a22-2d64-4052-8cec-d04af71cba0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:47:20 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-4783c9ae-efcc-473b-8487-67f6708cde60 tempest-ProjectMemberTests-1693853425 None] Deleted volume successfully. Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b370c02-0b70-4453-929b-5a5588135a63]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-54c63f4d-0943-48bc-9ed3-105abdfdd31b tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-4783c9ae-efcc-473b-8487-67f6708cde60 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-32d6e132-6326-4123-8f2c-32afd34570f5-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:20 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d Nov 06 14:47:20 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:21 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-54c63f4d-0943-48bc-9ed3-105abdfdd31b tempest-ProjectReaderTests-1181373823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d" returned: 0 in 0.399s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-54c63f4d-0943-48bc-9ed3-105abdfdd31b tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d.eda3675f-868f-4f2c-9102-2af92be078c1 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:21 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d.eda3675f-868f-4f2c-9102-2af92be078c1 Nov 06 14:47:21 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Flow 'volume_create_manager' (3f7718ed-6375-42c2-82df-9137e606dbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c3c276-0081-43e2-a924-b9561ac1d4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c3c276-0081-43e2-a924-b9561ac1d4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-138981490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bbac687-d959-4dcd-8e42-2fa015a05ba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='babad70bf4064f0c988ad5aee77822ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:47:21Z,use_quota=True,user_id='874776ea9ab343e5a2850727553c4735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53752266-fe52-4340-aff6-2422766faf3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53752266-fe52-4340-aff6-2422766faf3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f36ac7ae-bcd0-4d71-8421-179c2b9151b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f36ac7ae-bcd0-4d71-8421-179c2b9151b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bbac687-d959-4dcd-8e42-2fa015a05ba2', 'volume_name': 'volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5517db93-eb52-4c41-8ab1-440f7b42c995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5517db93-eb52-4c41-8ab1-440f7b42c995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb37e82-5cb2-4940-a9de-94f1ad430332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:21 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Volume 3bbac687-d959-4dcd-8e42-2fa015a05ba2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2', 'volume_size': 1} Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-138981490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bbac687-d959-4dcd-8e42-2fa015a05ba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='babad70bf4064f0c988ad5aee77822ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:47:21Z,use_quota=True,user_id='874776ea9ab343e5a2850727553c4735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Creating volume 3bbac687-d959-4dcd-8e42-2fa015a05ba2 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:47:21 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:21 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2 1073741824 Nov 06 14:47:21 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:21 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-54c63f4d-0943-48bc-9ed3-105abdfdd31b tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d.eda3675f-868f-4f2c-9102-2af92be078c1" returned: 0 in 0.355s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-54c63f4d-0943-48bc-9ed3-105abdfdd31b tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d.eda3675f-868f-4f2c-9102-2af92be078c1 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:21 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d.eda3675f-868f-4f2c-9102-2af92be078c1 Nov 06 14:47:21 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:21 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2 1073741824" returned: 0 in 0.429s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:21 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-54c63f4d-0943-48bc-9ed3-105abdfdd31b tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d.eda3675f-868f-4f2c-9102-2af92be078c1" returned: 0 in 0.274s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:21 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2 Nov 06 14:47:21 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-54c63f4d-0943-48bc-9ed3-105abdfdd31b tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-eda3675f-868f-4f2c-9102-2af92be078c1" released by "_delete_snapshot" :: held 1.538s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-54c63f4d-0943-48bc-9ed3-105abdfdd31b tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-4bca6a22-2d64-4052-8cec-d04af71cba0d" released by "delete_snapshot" :: held 1.564s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-54c63f4d-0943-48bc-9ed3-105abdfdd31b tempest-ProjectReaderTests-1181373823 None] Created reservations ['0fcb4c5f-3c2d-4ce3-a77d-29009b5ac34b', '4fa5ad36-fa35-43da-88c8-710489f342cd', '2f7e7361-abe2-4b47-acdd-b7bba39657b5', '8a20c94a-7b6c-4d2d-824a-4c0f7ba7fd31'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:47:21 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-54c63f4d-0943-48bc-9ed3-105abdfdd31b tempest-ProjectReaderTests-1181373823 None] Delete snapshot completed successfully. Nov 06 14:47:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-54c63f4d-0943-48bc-9ed3-105abdfdd31b tempest-ProjectReaderTests-1181373823 None] Lock "cinder-eda3675f-868f-4f2c-9102-2af92be078c1-delete_snapshot" released by "delete_snapshot" :: held 1.703s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:22 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2" returned: 0 in 0.252s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:22 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:47:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:22 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb37e82-5cb2-4940-a9de-94f1ad430332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:22 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (260afd31-a285-4217-911f-4dbccb2da7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:22 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Volume volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2 (3bbac687-d959-4dcd-8e42-2fa015a05ba2): created successfully Nov 06 14:47:22 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (260afd31-a285-4217-911f-4dbccb2da7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:22 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Flow 'volume_create_manager' (3f7718ed-6375-42c2-82df-9137e606dbbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:47:22 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-3b73440f-ca18-4e90-ac69-5ebbb9cdb9de tempest-ProjectMemberTests-1693853425 None] Created volume successfully. Nov 06 14:47:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8c2feb71-73ce-4a39-be6f-4f958e4401cd tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8c2feb71-73ce-4a39-be6f-4f958e4401cd tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:22 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-8c2feb71-73ce-4a39-be6f-4f958e4401cd tempest-ProjectMemberTests-1693853425 None] Creating offline snapshot 626d49b5-71e1-4907-9156-76bc0663a643 of volume 3bbac687-d959-4dcd-8e42-2fa015a05ba2 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:47:22 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[925ae7b1-226a-4f70-96ab-9efd024fed7d]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8c2feb71-73ce-4a39-be6f-4f958e4401cd tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b707a7bd-dcc6-4df5-9aab-475b16e177ad tempest-ProjectReaderTests-1181373823 None] Acquiring lock "cinder-4bca6a22-2d64-4052-8cec-d04af71cba0d-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b707a7bd-dcc6-4df5-9aab-475b16e177ad tempest-ProjectReaderTests-1181373823 None] Lock "cinder-4bca6a22-2d64-4052-8cec-d04af71cba0d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b707a7bd-dcc6-4df5-9aab-475b16e177ad tempest-ProjectReaderTests-1181373823 None] Acquiring lock "cinder-quobyte-4bca6a22-2d64-4052-8cec-d04af71cba0d" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:22 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b707a7bd-dcc6-4df5-9aab-475b16e177ad tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-4bca6a22-2d64-4052-8cec-d04af71cba0d" acquired by "delete_volume" :: waited 0.018s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:22 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2 Nov 06 14:47:22 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:22 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6046d01-c39f-4d86-8a35-014292813e35]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b707a7bd-dcc6-4df5-9aab-475b16e177ad tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:22 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d Nov 06 14:47:22 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:22 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8c2feb71-73ce-4a39-be6f-4f958e4401cd tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2" returned: 0 in 0.384s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8c2feb71-73ce-4a39-be6f-4f958e4401cd tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2.626d49b5-71e1-4907-9156-76bc0663a643 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:22 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2.626d49b5-71e1-4907-9156-76bc0663a643 1G Nov 06 14:47:22 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:22 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b707a7bd-dcc6-4df5-9aab-475b16e177ad tempest-ProjectReaderTests-1181373823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d" returned: 0 in 0.384s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:22 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b707a7bd-dcc6-4df5-9aab-475b16e177ad tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:22 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d Nov 06 14:47:22 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:23 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:47:23 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:23 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b707a7bd-dcc6-4df5-9aab-475b16e177ad tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-4bca6a22-2d64-4052-8cec-d04af71cba0d" returned: 0 in 0.264s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:23 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8c2feb71-73ce-4a39-be6f-4f958e4401cd tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2.626d49b5-71e1-4907-9156-76bc0663a643 1G" returned: 0 in 0.453s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8c2feb71-73ce-4a39-be6f-4f958e4401cd tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2.626d49b5-71e1-4907-9156-76bc0663a643 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b707a7bd-dcc6-4df5-9aab-475b16e177ad tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-4bca6a22-2d64-4052-8cec-d04af71cba0d" released by "delete_volume" :: held 0.739s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:23 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2.626d49b5-71e1-4907-9156-76bc0663a643 Nov 06 14:47:23 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-b707a7bd-dcc6-4df5-9aab-475b16e177ad tempest-ProjectReaderTests-1181373823 None] Created reservations ['6743962a-05c8-4b94-9c33-5ae9b4d83283', '0eb9a1bd-e3aa-409c-b1e8-23397883bde9', '30203a61-e9be-4dc0-b9e8-bd4b2be1c379', 'c9ca08ea-c13e-4d6a-8fe3-a3144a74b2b2'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b707a7bd-dcc6-4df5-9aab-475b16e177ad tempest-ProjectReaderTests-1181373823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b707a7bd-dcc6-4df5-9aab-475b16e177ad tempest-ProjectReaderTests-1181373823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b707a7bd-dcc6-4df5-9aab-475b16e177ad tempest-ProjectReaderTests-1181373823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b707a7bd-dcc6-4df5-9aab-475b16e177ad tempest-ProjectReaderTests-1181373823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b707a7bd-dcc6-4df5-9aab-475b16e177ad tempest-ProjectReaderTests-1181373823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b707a7bd-dcc6-4df5-9aab-475b16e177ad tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:23 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:47:23 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:23 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.323s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager._thread_info {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread count: 28 {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread info: [<_MainThread(MainThread, started 130306900594816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 14:47:23 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8c2feb71-73ce-4a39-be6f-4f958e4401cd tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2.626d49b5-71e1-4907-9156-76bc0663a643" returned: 0 in 0.365s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:23 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-8c2feb71-73ce-4a39-be6f-4f958e4401cd tempest-ProjectMemberTests-1693853425 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2.626d49b5-71e1-4907-9156-76bc0663a643 is being set with open permissions: ugo+rw Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8c2feb71-73ce-4a39-be6f-4f958e4401cd tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2.626d49b5-71e1-4907-9156-76bc0663a643 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:23 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2.626d49b5-71e1-4907-9156-76bc0663a643 Nov 06 14:47:23 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:23 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b707a7bd-dcc6-4df5-9aab-475b16e177ad tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.289s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-b707a7bd-dcc6-4df5-9aab-475b16e177ad tempest-ProjectReaderTests-1181373823 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:47:23 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-b707a7bd-dcc6-4df5-9aab-475b16e177ad tempest-ProjectReaderTests-1181373823 None] Deleted volume successfully. Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b707a7bd-dcc6-4df5-9aab-475b16e177ad tempest-ProjectReaderTests-1181373823 None] Lock "cinder-4bca6a22-2d64-4052-8cec-d04af71cba0d-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:23 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8c2feb71-73ce-4a39-be6f-4f958e4401cd tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2.626d49b5-71e1-4907-9156-76bc0663a643" returned: 0 in 0.272s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8c2feb71-73ce-4a39-be6f-4f958e4401cd tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:23 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2.info Nov 06 14:47:23 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:24 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:47:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Flow 'volume_create_manager' (d3d23c80-f286-48c5-ad45-57d7f39e93c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:47:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f6e234-676e-403b-bbba-e3f8fe2168ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f6e234-676e-403b-bbba-e3f8fe2168ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1723576684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e57bf2a-f556-41d4-964b-57e8fa93222c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f90f94b028bb4f3d866fc4b4ef171818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:47:24Z,use_quota=True,user_id='6b0a7a9d8c014b02a857c1931fd0d85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c68d249-9604-4839-b27e-53b03b086f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c68d249-9604-4839-b27e-53b03b086f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a49edec6-f891-409b-8d1d-874e30078569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a49edec6-f891-409b-8d1d-874e30078569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e57bf2a-f556-41d4-964b-57e8fa93222c', 'volume_name': 'volume-7e57bf2a-f556-41d4-964b-57e8fa93222c', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525ead12-964b-49a4-8199-c9dfd1b9d8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525ead12-964b-49a4-8199-c9dfd1b9d8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:24 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db0e0400-431f-4131-b1e5-246b7f8f775a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:24 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Volume 7e57bf2a-f556-41d4-964b-57e8fa93222c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e57bf2a-f556-41d4-964b-57e8fa93222c', 'volume_size': 1} Nov 06 14:47:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:24 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8c2feb71-73ce-4a39-be6f-4f958e4401cd tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2.info" returned: 0 in 0.282s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:24 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-8c2feb71-73ce-4a39-be6f-4f958e4401cd tempest-ProjectMemberTests-1693853425 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2.info is being set with open permissions: ugo+rw Nov 06 14:47:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8c2feb71-73ce-4a39-be6f-4f958e4401cd tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:24 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2.info Nov 06 14:47:24 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:24 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-8c2feb71-73ce-4a39-be6f-4f958e4401cd tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2.info" returned: 0 in 0.245s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-8c2feb71-73ce-4a39-be6f-4f958e4401cd tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.093s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.296s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1723576684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e57bf2a-f556-41d4-964b-57e8fa93222c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f90f94b028bb4f3d866fc4b4ef171818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:47:24Z,use_quota=True,user_id='6b0a7a9d8c014b02a857c1931fd0d85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:47:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Creating volume 7e57bf2a-f556-41d4-964b-57e8fa93222c {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:47:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:47:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:47:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:24 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:47:24 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:47:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:24 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c 1073741824 Nov 06 14:47:24 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:24 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-8c2feb71-73ce-4a39-be6f-4f958e4401cd tempest-ProjectMemberTests-1693853425 None] Create snapshot completed successfully Nov 06 14:47:24 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c 1073741824" returned: 0 in 0.400s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:24 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:24 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c Nov 06 14:47:24 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:25 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c" returned: 0 in 0.240s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:47:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db0e0400-431f-4131-b1e5-246b7f8f775a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e57bf2a-f556-41d4-964b-57e8fa93222c', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba617ab-4d9a-4bff-87ff-c3ac118108a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:25 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Volume volume-7e57bf2a-f556-41d4-964b-57e8fa93222c (7e57bf2a-f556-41d4-964b-57e8fa93222c): created successfully Nov 06 14:47:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba617ab-4d9a-4bff-87ff-c3ac118108a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:25 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Flow 'volume_create_manager' (d3d23c80-f286-48c5-ad45-57d7f39e93c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:47:25 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-ecaef21d-3897-4dd0-a126-c2b99c204294 tempest-ProjectReaderTests-1181373823 None] Created volume successfully. Nov 06 14:47:25 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-51e80790-8f4a-4abb-ac9c-cde2c6cdea38 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-626d49b5-71e1-4907-9156-76bc0663a643-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:25 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-51e80790-8f4a-4abb-ac9c-cde2c6cdea38 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-626d49b5-71e1-4907-9156-76bc0663a643-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:25 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-51e80790-8f4a-4abb-ac9c-cde2c6cdea38 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-quobyte-3bbac687-d959-4dcd-8e42-2fa015a05ba2" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:25 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-51e80790-8f4a-4abb-ac9c-cde2c6cdea38 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-3bbac687-d959-4dcd-8e42-2fa015a05ba2" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:25 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-51e80790-8f4a-4abb-ac9c-cde2c6cdea38 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-quobyte-626d49b5-71e1-4907-9156-76bc0663a643" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:25 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-51e80790-8f4a-4abb-ac9c-cde2c6cdea38 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-626d49b5-71e1-4907-9156-76bc0663a643" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-51e80790-8f4a-4abb-ac9c-cde2c6cdea38 tempest-ProjectMemberTests-1693853425 None] Deleting offline snapshot 626d49b5-71e1-4907-9156-76bc0663a643 of volume 3bbac687-d959-4dcd-8e42-2fa015a05ba2 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:47:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-51e80790-8f4a-4abb-ac9c-cde2c6cdea38 tempest-ProjectMemberTests-1693853425 None] snapshot_file for this snap is: volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2.626d49b5-71e1-4907-9156-76bc0663a643 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:47:25 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfe6862-5581-4d95-ab56-7fd1e8985e75]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-51e80790-8f4a-4abb-ac9c-cde2c6cdea38 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2.626d49b5-71e1-4907-9156-76bc0663a643 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:25 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2.626d49b5-71e1-4907-9156-76bc0663a643 Nov 06 14:47:25 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:25 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:25 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-51e80790-8f4a-4abb-ac9c-cde2c6cdea38 tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2.626d49b5-71e1-4907-9156-76bc0663a643" returned: 0 in 0.358s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:25 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-51e80790-8f4a-4abb-ac9c-cde2c6cdea38 tempest-ProjectMemberTests-1693853425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:47:26 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[61beaca8-2f27-4bf7-98dc-5cac136840bb]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-51e80790-8f4a-4abb-ac9c-cde2c6cdea38 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:26 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2 Nov 06 14:47:26 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-039457e2-982d-462d-ad2b-fa8cf13fb446 tempest-ProjectReaderTests-1181373823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-039457e2-982d-462d-ad2b-fa8cf13fb446 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:26 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-039457e2-982d-462d-ad2b-fa8cf13fb446 tempest-ProjectReaderTests-1181373823 None] Creating offline snapshot b1d33bbb-e501-4681-8a20-b88319d9c1cb of volume 7e57bf2a-f556-41d4-964b-57e8fa93222c {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:47:26 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[f813db67-4c2a-4a41-99db-fdbb11ca713f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-039457e2-982d-462d-ad2b-fa8cf13fb446 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:26 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-51e80790-8f4a-4abb-ac9c-cde2c6cdea38 tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2" returned: 0 in 0.381s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-51e80790-8f4a-4abb-ac9c-cde2c6cdea38 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2.626d49b5-71e1-4907-9156-76bc0663a643 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:26 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2.626d49b5-71e1-4907-9156-76bc0663a643 Nov 06 14:47:26 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:26 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c Nov 06 14:47:26 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:26 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-039457e2-982d-462d-ad2b-fa8cf13fb446 tempest-ProjectReaderTests-1181373823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c" returned: 0 in 0.368s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-039457e2-982d-462d-ad2b-fa8cf13fb446 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c.b1d33bbb-e501-4681-8a20-b88319d9c1cb 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:26 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-51e80790-8f4a-4abb-ac9c-cde2c6cdea38 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2.626d49b5-71e1-4907-9156-76bc0663a643" returned: 0 in 0.341s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:26 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c.b1d33bbb-e501-4681-8a20-b88319d9c1cb 1G Nov 06 14:47:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-51e80790-8f4a-4abb-ac9c-cde2c6cdea38 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2.626d49b5-71e1-4907-9156-76bc0663a643 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:26 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:26 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2.626d49b5-71e1-4907-9156-76bc0663a643 Nov 06 14:47:26 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:26 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:26 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-51e80790-8f4a-4abb-ac9c-cde2c6cdea38 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2.626d49b5-71e1-4907-9156-76bc0663a643" returned: 0 in 0.252s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:27 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-51e80790-8f4a-4abb-ac9c-cde2c6cdea38 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-626d49b5-71e1-4907-9156-76bc0663a643" released by "_delete_snapshot" :: held 1.432s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:27 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-51e80790-8f4a-4abb-ac9c-cde2c6cdea38 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-3bbac687-d959-4dcd-8e42-2fa015a05ba2" released by "delete_snapshot" :: held 1.452s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:27 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-51e80790-8f4a-4abb-ac9c-cde2c6cdea38 tempest-ProjectMemberTests-1693853425 None] Created reservations ['f4812fd1-3afb-4582-ab8e-c7ed527a7ee4', '5e40c635-f16e-4848-b70c-07a96567925d', '24e50333-23f3-4ec4-a040-99e0f8967029', '8486ffa6-6b7c-4c9d-8c62-5707d3ca06e2'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:47:27 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-039457e2-982d-462d-ad2b-fa8cf13fb446 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c.b1d33bbb-e501-4681-8a20-b88319d9c1cb 1G" returned: 0 in 0.410s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-039457e2-982d-462d-ad2b-fa8cf13fb446 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e57bf2a-f556-41d4-964b-57e8fa93222c -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c.b1d33bbb-e501-4681-8a20-b88319d9c1cb {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:27 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e57bf2a-f556-41d4-964b-57e8fa93222c -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c.b1d33bbb-e501-4681-8a20-b88319d9c1cb Nov 06 14:47:27 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:27 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-51e80790-8f4a-4abb-ac9c-cde2c6cdea38 tempest-ProjectMemberTests-1693853425 None] Delete snapshot completed successfully. Nov 06 14:47:27 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-51e80790-8f4a-4abb-ac9c-cde2c6cdea38 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-626d49b5-71e1-4907-9156-76bc0663a643-delete_snapshot" released by "delete_snapshot" :: held 1.605s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:27 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-039457e2-982d-462d-ad2b-fa8cf13fb446 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e57bf2a-f556-41d4-964b-57e8fa93222c -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c.b1d33bbb-e501-4681-8a20-b88319d9c1cb" returned: 0 in 0.286s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:27 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-039457e2-982d-462d-ad2b-fa8cf13fb446 tempest-ProjectReaderTests-1181373823 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c.b1d33bbb-e501-4681-8a20-b88319d9c1cb is being set with open permissions: ugo+rw Nov 06 14:47:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-039457e2-982d-462d-ad2b-fa8cf13fb446 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c.b1d33bbb-e501-4681-8a20-b88319d9c1cb {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:27 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c.b1d33bbb-e501-4681-8a20-b88319d9c1cb Nov 06 14:47:27 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:27 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-039457e2-982d-462d-ad2b-fa8cf13fb446 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c.b1d33bbb-e501-4681-8a20-b88319d9c1cb" returned: 0 in 0.248s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-039457e2-982d-462d-ad2b-fa8cf13fb446 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:27 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c.info Nov 06 14:47:27 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:27 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d45d77b7-4bec-417a-8c4d-cc9dc47cf152 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-3bbac687-d959-4dcd-8e42-2fa015a05ba2-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:27 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d45d77b7-4bec-417a-8c4d-cc9dc47cf152 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-3bbac687-d959-4dcd-8e42-2fa015a05ba2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:27 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d45d77b7-4bec-417a-8c4d-cc9dc47cf152 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-quobyte-3bbac687-d959-4dcd-8e42-2fa015a05ba2" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:27 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d45d77b7-4bec-417a-8c4d-cc9dc47cf152 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-3bbac687-d959-4dcd-8e42-2fa015a05ba2" acquired by "delete_volume" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:27 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[d945c264-70ed-4500-86d0-7d4cf57b015f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d45d77b7-4bec-417a-8c4d-cc9dc47cf152 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:27 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2 Nov 06 14:47:27 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:27 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-039457e2-982d-462d-ad2b-fa8cf13fb446 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c.info" returned: 0 in 0.284s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:27 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-039457e2-982d-462d-ad2b-fa8cf13fb446 tempest-ProjectReaderTests-1181373823 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c.info is being set with open permissions: ugo+rw Nov 06 14:47:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-039457e2-982d-462d-ad2b-fa8cf13fb446 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:27 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c.info Nov 06 14:47:27 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:28 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-039457e2-982d-462d-ad2b-fa8cf13fb446 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c.info" returned: 0 in 0.246s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:28 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-039457e2-982d-462d-ad2b-fa8cf13fb446 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.943s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d45d77b7-4bec-417a-8c4d-cc9dc47cf152 tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2" returned: 0 in 0.409s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d45d77b7-4bec-417a-8c4d-cc9dc47cf152 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:28 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-039457e2-982d-462d-ad2b-fa8cf13fb446 tempest-ProjectReaderTests-1181373823 None] Create snapshot completed successfully Nov 06 14:47:28 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2 Nov 06 14:47:28 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f786b699-8550-4902-ad47-fc8130b6fb49 tempest-ProjectReaderTests-1181373823 None] Acquiring lock "cinder-b1d33bbb-e501-4681-8a20-b88319d9c1cb-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f786b699-8550-4902-ad47-fc8130b6fb49 tempest-ProjectReaderTests-1181373823 None] Lock "cinder-b1d33bbb-e501-4681-8a20-b88319d9c1cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f786b699-8550-4902-ad47-fc8130b6fb49 tempest-ProjectReaderTests-1181373823 None] Acquiring lock "cinder-quobyte-7e57bf2a-f556-41d4-964b-57e8fa93222c" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f786b699-8550-4902-ad47-fc8130b6fb49 tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-7e57bf2a-f556-41d4-964b-57e8fa93222c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f786b699-8550-4902-ad47-fc8130b6fb49 tempest-ProjectReaderTests-1181373823 None] Acquiring lock "cinder-quobyte-b1d33bbb-e501-4681-8a20-b88319d9c1cb" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f786b699-8550-4902-ad47-fc8130b6fb49 tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-b1d33bbb-e501-4681-8a20-b88319d9c1cb" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-f786b699-8550-4902-ad47-fc8130b6fb49 tempest-ProjectReaderTests-1181373823 None] Deleting offline snapshot b1d33bbb-e501-4681-8a20-b88319d9c1cb of volume 7e57bf2a-f556-41d4-964b-57e8fa93222c {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-f786b699-8550-4902-ad47-fc8130b6fb49 tempest-ProjectReaderTests-1181373823 None] snapshot_file for this snap is: volume-7e57bf2a-f556-41d4-964b-57e8fa93222c.b1d33bbb-e501-4681-8a20-b88319d9c1cb {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:47:28 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d45d77b7-4bec-417a-8c4d-cc9dc47cf152 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-3bbac687-d959-4dcd-8e42-2fa015a05ba2" returned: 0 in 0.274s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[b887d283-839f-4b32-9d4b-e352b617d150]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f786b699-8550-4902-ad47-fc8130b6fb49 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c.b1d33bbb-e501-4681-8a20-b88319d9c1cb {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d45d77b7-4bec-417a-8c4d-cc9dc47cf152 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-3bbac687-d959-4dcd-8e42-2fa015a05ba2" released by "delete_volume" :: held 0.759s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-d45d77b7-4bec-417a-8c4d-cc9dc47cf152 tempest-ProjectMemberTests-1693853425 None] Created reservations ['6b4982d6-b29d-4ab5-96ce-5c97bff127cb', '445314d0-e897-4473-b8b6-2c9e70fe3202', 'c8f2b819-91ef-4997-9ad3-473b43c3c34a', '33c92666-0cc2-4ecf-8fb5-5a2b6dd536f6'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d45d77b7-4bec-417a-8c4d-cc9dc47cf152 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d45d77b7-4bec-417a-8c4d-cc9dc47cf152 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d45d77b7-4bec-417a-8c4d-cc9dc47cf152 tempest-ProjectMemberTests-1693853425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:47:28 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c.b1d33bbb-e501-4681-8a20-b88319d9c1cb Nov 06 14:47:28 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-d45d77b7-4bec-417a-8c4d-cc9dc47cf152 tempest-ProjectMemberTests-1693853425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-d45d77b7-4bec-417a-8c4d-cc9dc47cf152 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d45d77b7-4bec-417a-8c4d-cc9dc47cf152 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:28 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:47:28 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:28 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f786b699-8550-4902-ad47-fc8130b6fb49 tempest-ProjectReaderTests-1181373823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c.b1d33bbb-e501-4681-8a20-b88319d9c1cb" returned: 0 in 0.403s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-f786b699-8550-4902-ad47-fc8130b6fb49 tempest-ProjectReaderTests-1181373823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e57bf2a-f556-41d4-964b-57e8fa93222c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:47:28 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-d45d77b7-4bec-417a-8c4d-cc9dc47cf152 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.300s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-d45d77b7-4bec-417a-8c4d-cc9dc47cf152 tempest-ProjectMemberTests-1693853425 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:47:28 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-d45d77b7-4bec-417a-8c4d-cc9dc47cf152 tempest-ProjectMemberTests-1693853425 None] Deleted volume successfully. Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[896b40e5-631e-438c-ade3-5250422c2a88]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f786b699-8550-4902-ad47-fc8130b6fb49 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-d45d77b7-4bec-417a-8c4d-cc9dc47cf152 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-3bbac687-d959-4dcd-8e42-2fa015a05ba2-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:29 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c Nov 06 14:47:29 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Flow 'volume_create_manager' (acbe5a04-befa-40ef-beb3-445d5d62a682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c259e2-bb6c-4b3e-ba08-626798b5ba2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:29 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f786b699-8550-4902-ad47-fc8130b6fb49 tempest-ProjectReaderTests-1181373823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c" returned: 0 in 0.388s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f786b699-8550-4902-ad47-fc8130b6fb49 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c.b1d33bbb-e501-4681-8a20-b88319d9c1cb {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:29 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c.b1d33bbb-e501-4681-8a20-b88319d9c1cb Nov 06 14:47:29 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c259e2-bb6c-4b3e-ba08-626798b5ba2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-738562180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b60ac7e-fd90-498b-9a6d-501f33bfe007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='babad70bf4064f0c988ad5aee77822ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:47:29Z,use_quota=True,user_id='874776ea9ab343e5a2850727553c4735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d51fee-5349-4ca4-a9b1-e4acbf55c4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d51fee-5349-4ca4-a9b1-e4acbf55c4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (768b68f4-109c-4587-9c93-29fb731cb8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (768b68f4-109c-4587-9c93-29fb731cb8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b60ac7e-fd90-498b-9a6d-501f33bfe007', 'volume_name': 'volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4269916a-7ae4-4d7b-82b2-78e9bf5592f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4269916a-7ae4-4d7b-82b2-78e9bf5592f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a58d48-05ee-45bd-8204-876a12a72a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:29 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Volume 5b60ac7e-fd90-498b-9a6d-501f33bfe007: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007', 'volume_size': 1} Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-738562180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b60ac7e-fd90-498b-9a6d-501f33bfe007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='babad70bf4064f0c988ad5aee77822ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:47:29Z,use_quota=True,user_id='874776ea9ab343e5a2850727553c4735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Creating volume 5b60ac7e-fd90-498b-9a6d-501f33bfe007 {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:47:29 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:29 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007 1073741824 Nov 06 14:47:29 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:29 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f786b699-8550-4902-ad47-fc8130b6fb49 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c.b1d33bbb-e501-4681-8a20-b88319d9c1cb" returned: 0 in 0.316s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f786b699-8550-4902-ad47-fc8130b6fb49 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c.b1d33bbb-e501-4681-8a20-b88319d9c1cb {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:29 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c.b1d33bbb-e501-4681-8a20-b88319d9c1cb Nov 06 14:47:29 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:29 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007 1073741824" returned: 0 in 0.439s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:29 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007 Nov 06 14:47:29 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:29 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-f786b699-8550-4902-ad47-fc8130b6fb49 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c.b1d33bbb-e501-4681-8a20-b88319d9c1cb" returned: 0 in 0.284s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f786b699-8550-4902-ad47-fc8130b6fb49 tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-b1d33bbb-e501-4681-8a20-b88319d9c1cb" released by "_delete_snapshot" :: held 1.537s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f786b699-8550-4902-ad47-fc8130b6fb49 tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-7e57bf2a-f556-41d4-964b-57e8fa93222c" released by "delete_snapshot" :: held 1.561s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:30 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-f786b699-8550-4902-ad47-fc8130b6fb49 tempest-ProjectReaderTests-1181373823 None] Created reservations ['ac909bdd-1f91-4d3c-bf4c-736b59040311', '6dce4cf2-4086-421d-a5fc-69594de7930f', 'b13eed73-cf22-408c-a23e-53f927867aa1', '6a2ce46d-e692-4e82-98b0-7c45120d2fd0'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:47:30 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-f786b699-8550-4902-ad47-fc8130b6fb49 tempest-ProjectReaderTests-1181373823 None] Delete snapshot completed successfully. Nov 06 14:47:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-f786b699-8550-4902-ad47-fc8130b6fb49 tempest-ProjectReaderTests-1181373823 None] Lock "cinder-b1d33bbb-e501-4681-8a20-b88319d9c1cb-delete_snapshot" released by "delete_snapshot" :: held 1.699s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:30 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007" returned: 0 in 0.252s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:30 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:47:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:30 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a58d48-05ee-45bd-8204-876a12a72a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:30 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (331dd932-59af-42c6-b8e0-f915addfb650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:47:30 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Volume volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007 (5b60ac7e-fd90-498b-9a6d-501f33bfe007): created successfully Nov 06 14:47:30 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (331dd932-59af-42c6-b8e0-f915addfb650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:47:30 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Flow 'volume_create_manager' (acbe5a04-befa-40ef-beb3-445d5d62a682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:47:30 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-ff10d052-3eca-4ece-a7f3-6b0acd120d22 tempest-ProjectMemberTests-1693853425 None] Created volume successfully. Nov 06 14:47:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c72677f3-1027-47f6-9860-4561073e906c tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c72677f3-1027-47f6-9860-4561073e906c tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:30 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-c72677f3-1027-47f6-9860-4561073e906c tempest-ProjectMemberTests-1693853425 None] Creating offline snapshot e0e4e576-a452-4894-877f-ced2cd324e10 of volume 5b60ac7e-fd90-498b-9a6d-501f33bfe007 {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:47:30 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[982eeb5b-6597-4454-9f79-91eb0869fe48]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c72677f3-1027-47f6-9860-4561073e906c tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:30 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007 Nov 06 14:47:30 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2f9fdaf6-2a78-41a4-b082-ca9d055ecd82 tempest-ProjectReaderTests-1181373823 None] Acquiring lock "cinder-7e57bf2a-f556-41d4-964b-57e8fa93222c-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2f9fdaf6-2a78-41a4-b082-ca9d055ecd82 tempest-ProjectReaderTests-1181373823 None] Lock "cinder-7e57bf2a-f556-41d4-964b-57e8fa93222c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2f9fdaf6-2a78-41a4-b082-ca9d055ecd82 tempest-ProjectReaderTests-1181373823 None] Acquiring lock "cinder-quobyte-7e57bf2a-f556-41d4-964b-57e8fa93222c" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2f9fdaf6-2a78-41a4-b082-ca9d055ecd82 tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-7e57bf2a-f556-41d4-964b-57e8fa93222c" acquired by "delete_volume" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:30 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c72677f3-1027-47f6-9860-4561073e906c tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007" returned: 0 in 0.427s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c72677f3-1027-47f6-9860-4561073e906c tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007.e0e4e576-a452-4894-877f-ced2cd324e10 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:30 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bac1ab3-847d-4a4c-a859-b5d9eb22e079]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2f9fdaf6-2a78-41a4-b082-ca9d055ecd82 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:30 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007.e0e4e576-a452-4894-877f-ced2cd324e10 1G Nov 06 14:47:30 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:31 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c Nov 06 14:47:31 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:31 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c72677f3-1027-47f6-9860-4561073e906c tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007.e0e4e576-a452-4894-877f-ced2cd324e10 1G" returned: 0 in 0.397s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c72677f3-1027-47f6-9860-4561073e906c tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007.e0e4e576-a452-4894-877f-ced2cd324e10 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:31 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2f9fdaf6-2a78-41a4-b082-ca9d055ecd82 tempest-ProjectReaderTests-1181373823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c" returned: 0 in 0.393s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2f9fdaf6-2a78-41a4-b082-ca9d055ecd82 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:31 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007.e0e4e576-a452-4894-877f-ced2cd324e10 Nov 06 14:47:31 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:31 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c Nov 06 14:47:31 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:31 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2f9fdaf6-2a78-41a4-b082-ca9d055ecd82 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7e57bf2a-f556-41d4-964b-57e8fa93222c" returned: 0 in 0.256s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:31 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2f9fdaf6-2a78-41a4-b082-ca9d055ecd82 tempest-ProjectReaderTests-1181373823 None] Lock "cinder-quobyte-7e57bf2a-f556-41d4-964b-57e8fa93222c" released by "delete_volume" :: held 0.721s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:31 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:31 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:UPDATE=324,cinder:SELECT=217,cinder:INSERT=73,cinder:DELETE=25 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:47:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c72677f3-1027-47f6-9860-4561073e906c tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007 -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007.e0e4e576-a452-4894-877f-ced2cd324e10" returned: 0 in 0.303s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:31 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-c72677f3-1027-47f6-9860-4561073e906c tempest-ProjectMemberTests-1693853425 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007.e0e4e576-a452-4894-877f-ced2cd324e10 is being set with open permissions: ugo+rw Nov 06 14:47:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c72677f3-1027-47f6-9860-4561073e906c tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007.e0e4e576-a452-4894-877f-ced2cd324e10 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:31 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007.e0e4e576-a452-4894-877f-ced2cd324e10 Nov 06 14:47:31 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:31 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-2f9fdaf6-2a78-41a4-b082-ca9d055ecd82 tempest-ProjectReaderTests-1181373823 None] Created reservations ['deafb5d1-9cc3-424d-b283-a8e1082cc7bf', 'b50d6c7d-520b-4e38-a3b3-96872856c7a5', '842cad0e-7d1f-483e-ba54-fc12065444af', '8fcb4682-7a5e-4726-9e94-abe07dba50a8'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:47:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2f9fdaf6-2a78-41a4-b082-ca9d055ecd82 tempest-ProjectReaderTests-1181373823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2f9fdaf6-2a78-41a4-b082-ca9d055ecd82 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:31 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2f9fdaf6-2a78-41a4-b082-ca9d055ecd82 tempest-ProjectReaderTests-1181373823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:47:31 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-2f9fdaf6-2a78-41a4-b082-ca9d055ecd82 tempest-ProjectReaderTests-1181373823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:47:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-2f9fdaf6-2a78-41a4-b082-ca9d055ecd82 tempest-ProjectReaderTests-1181373823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2f9fdaf6-2a78-41a4-b082-ca9d055ecd82 tempest-ProjectReaderTests-1181373823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:31 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:47:31 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:31 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c72677f3-1027-47f6-9860-4561073e906c tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007.e0e4e576-a452-4894-877f-ced2cd324e10" returned: 0 in 0.252s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:31 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:UPDATE=297,cinder:DELETE=26,cinder:INSERT=93,cinder:SELECT=239 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:47:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c72677f3-1027-47f6-9860-4561073e906c tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:31 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007.info Nov 06 14:47:31 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:32 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-2f9fdaf6-2a78-41a4-b082-ca9d055ecd82 tempest-ProjectReaderTests-1181373823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.280s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:32 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-2f9fdaf6-2a78-41a4-b082-ca9d055ecd82 tempest-ProjectReaderTests-1181373823 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:47:32 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-2f9fdaf6-2a78-41a4-b082-ca9d055ecd82 tempest-ProjectReaderTests-1181373823 None] Deleted volume successfully. Nov 06 14:47:32 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-2f9fdaf6-2a78-41a4-b082-ca9d055ecd82 tempest-ProjectReaderTests-1181373823 None] Lock "cinder-7e57bf2a-f556-41d4-964b-57e8fa93222c-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:32 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c72677f3-1027-47f6-9860-4561073e906c tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007.info" returned: 0 in 0.281s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:32 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-c72677f3-1027-47f6-9860-4561073e906c tempest-ProjectMemberTests-1693853425 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007.info is being set with open permissions: ugo+rw Nov 06 14:47:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c72677f3-1027-47f6-9860-4561073e906c tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:32 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007.info Nov 06 14:47:32 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:32 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-c72677f3-1027-47f6-9860-4561073e906c tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007.info" returned: 0 in 0.258s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-c72677f3-1027-47f6-9860-4561073e906c tempest-ProjectMemberTests-1693853425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.019s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:32 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-c72677f3-1027-47f6-9860-4561073e906c tempest-ProjectMemberTests-1693853425 None] Create snapshot completed successfully Nov 06 14:47:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3aed9673-9ded-4422-b58e-b9840c4c5573 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-e0e4e576-a452-4894-877f-ced2cd324e10-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3aed9673-9ded-4422-b58e-b9840c4c5573 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-e0e4e576-a452-4894-877f-ced2cd324e10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3aed9673-9ded-4422-b58e-b9840c4c5573 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-quobyte-5b60ac7e-fd90-498b-9a6d-501f33bfe007" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3aed9673-9ded-4422-b58e-b9840c4c5573 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-5b60ac7e-fd90-498b-9a6d-501f33bfe007" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3aed9673-9ded-4422-b58e-b9840c4c5573 tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-quobyte-e0e4e576-a452-4894-877f-ced2cd324e10" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:33 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3aed9673-9ded-4422-b58e-b9840c4c5573 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-e0e4e576-a452-4894-877f-ced2cd324e10" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-3aed9673-9ded-4422-b58e-b9840c4c5573 tempest-ProjectMemberTests-1693853425 None] Deleting offline snapshot e0e4e576-a452-4894-877f-ced2cd324e10 of volume 5b60ac7e-fd90-498b-9a6d-501f33bfe007 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:47:33 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-3aed9673-9ded-4422-b58e-b9840c4c5573 tempest-ProjectMemberTests-1693853425 None] snapshot_file for this snap is: volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007.e0e4e576-a452-4894-877f-ced2cd324e10 {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:47:33 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[e655a007-63c0-40a9-9061-229d84903545]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:33 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3aed9673-9ded-4422-b58e-b9840c4c5573 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007.e0e4e576-a452-4894-877f-ced2cd324e10 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:34 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007.e0e4e576-a452-4894-877f-ced2cd324e10 Nov 06 14:47:34 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:34 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3aed9673-9ded-4422-b58e-b9840c4c5573 tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007.e0e4e576-a452-4894-877f-ced2cd324e10" returned: 0 in 0.375s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:34 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-3aed9673-9ded-4422-b58e-b9840c4c5573 tempest-ProjectMemberTests-1693853425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:47:34 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77b2c16-bdd9-4ad3-8022-f50e968d9890]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3aed9673-9ded-4422-b58e-b9840c4c5573 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:34 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007 Nov 06 14:47:34 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:34 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3aed9673-9ded-4422-b58e-b9840c4c5573 tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007" returned: 0 in 0.352s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3aed9673-9ded-4422-b58e-b9840c4c5573 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007.e0e4e576-a452-4894-877f-ced2cd324e10 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:34 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007.e0e4e576-a452-4894-877f-ced2cd324e10 Nov 06 14:47:34 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:34 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3aed9673-9ded-4422-b58e-b9840c4c5573 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007.e0e4e576-a452-4894-877f-ced2cd324e10" returned: 0 in 0.329s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:34 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3aed9673-9ded-4422-b58e-b9840c4c5573 tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007.e0e4e576-a452-4894-877f-ced2cd324e10 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:34 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007.e0e4e576-a452-4894-877f-ced2cd324e10 Nov 06 14:47:34 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:35 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:35 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3aed9673-9ded-4422-b58e-b9840c4c5573 tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007.e0e4e576-a452-4894-877f-ced2cd324e10" returned: 0 in 0.248s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3aed9673-9ded-4422-b58e-b9840c4c5573 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-e0e4e576-a452-4894-877f-ced2cd324e10" released by "_delete_snapshot" :: held 1.402s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3aed9673-9ded-4422-b58e-b9840c4c5573 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-5b60ac7e-fd90-498b-9a6d-501f33bfe007" released by "delete_snapshot" :: held 1.424s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:35 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-3aed9673-9ded-4422-b58e-b9840c4c5573 tempest-ProjectMemberTests-1693853425 None] Created reservations ['7a73c542-f9c6-4fe4-89e8-9ec104f8906d', '2fb0bc16-9df9-4a9e-bcf2-1ef28556aa34', '0202d7ba-81a7-4617-9ed4-58bcf1cf17ee', 'c0e54b60-1849-4011-a44f-2ebda7157044'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:47:35 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-3aed9673-9ded-4422-b58e-b9840c4c5573 tempest-ProjectMemberTests-1693853425 None] Delete snapshot completed successfully. Nov 06 14:47:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3aed9673-9ded-4422-b58e-b9840c4c5573 tempest-ProjectMemberTests-1693853425 None] Lock "cinder-e0e4e576-a452-4894-877f-ced2cd324e10-delete_snapshot" released by "delete_snapshot" :: held 1.554s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b6e008a0-7609-4515-8a5c-47673bbf262a tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-5b60ac7e-fd90-498b-9a6d-501f33bfe007-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:35 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b6e008a0-7609-4515-8a5c-47673bbf262a tempest-ProjectMemberTests-1693853425 None] Lock "cinder-5b60ac7e-fd90-498b-9a6d-501f33bfe007-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:36 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b6e008a0-7609-4515-8a5c-47673bbf262a tempest-ProjectMemberTests-1693853425 None] Acquiring lock "cinder-quobyte-5b60ac7e-fd90-498b-9a6d-501f33bfe007" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:47:36 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b6e008a0-7609-4515-8a5c-47673bbf262a tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-5b60ac7e-fd90-498b-9a6d-501f33bfe007" acquired by "delete_volume" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:47:36 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d7d1a6-289e-4d33-844f-ebc3e3a4449f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:47:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b6e008a0-7609-4515-8a5c-47673bbf262a tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:36 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007 Nov 06 14:47:36 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:36 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b6e008a0-7609-4515-8a5c-47673bbf262a tempest-ProjectMemberTests-1693853425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007" returned: 0 in 0.357s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b6e008a0-7609-4515-8a5c-47673bbf262a tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:36 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007 Nov 06 14:47:36 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:36 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b6e008a0-7609-4515-8a5c-47673bbf262a tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-5b60ac7e-fd90-498b-9a6d-501f33bfe007" returned: 0 in 0.240s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:36 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b6e008a0-7609-4515-8a5c-47673bbf262a tempest-ProjectMemberTests-1693853425 None] Lock "cinder-quobyte-5b60ac7e-fd90-498b-9a6d-501f33bfe007" released by "delete_volume" :: held 0.665s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:36 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-b6e008a0-7609-4515-8a5c-47673bbf262a tempest-ProjectMemberTests-1693853425 None] Created reservations ['63069bb4-44b7-4012-be82-17c6c356d636', '087e9d99-cdc1-4987-9534-6f2a94dbb97f', '659e29f1-f954-4670-a1aa-ed71abb8c80e', 'e5bb01f5-6f7c-43cd-b786-601ca0d8652a'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:47:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b6e008a0-7609-4515-8a5c-47673bbf262a tempest-ProjectMemberTests-1693853425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:47:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b6e008a0-7609-4515-8a5c-47673bbf262a tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:47:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b6e008a0-7609-4515-8a5c-47673bbf262a tempest-ProjectMemberTests-1693853425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:47:36 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-b6e008a0-7609-4515-8a5c-47673bbf262a tempest-ProjectMemberTests-1693853425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:47:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-b6e008a0-7609-4515-8a5c-47673bbf262a tempest-ProjectMemberTests-1693853425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:47:36 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b6e008a0-7609-4515-8a5c-47673bbf262a tempest-ProjectMemberTests-1693853425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:47:36 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:47:36 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:47:37 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Nov 06 14:47:37 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-b6e008a0-7609-4515-8a5c-47673bbf262a tempest-ProjectMemberTests-1693853425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.247s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:47:37 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-b6e008a0-7609-4515-8a5c-47673bbf262a tempest-ProjectMemberTests-1693853425 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:47:37 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-b6e008a0-7609-4515-8a5c-47673bbf262a tempest-ProjectMemberTests-1693853425 None] Deleted volume successfully. Nov 06 14:47:37 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-b6e008a0-7609-4515-8a5c-47673bbf262a tempest-ProjectMemberTests-1693853425 None] Lock "cinder-5b60ac7e-fd90-498b-9a6d-501f33bfe007-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:47:46 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:UPDATE=28,cinder:SELECT=8,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:47:47 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:DELETE=2,cinder:UPDATE=9,cinder:SELECT=13,cinder:INSERT=3 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:48:16 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Flow 'volume_create_manager' (ff9e2ce1-5cc5-462d-9a9c-0f7f5ccbcdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ea936c-3b03-4267-a813-a846b87caeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ea936c-3b03-4267-a813-a846b87caeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-710273548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfe66188652442b6a0cfeeebb06c8e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:48:17Z,use_quota=True,user_id='62036f114ead40eda2fed66cae347072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0983b29c-ffc3-4064-a4f4-d99c8ec6c7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0983b29c-ffc3-4064-a4f4-d99c8ec6c7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b650e1de-39db-4dff-a758-6c8f25a8ef26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b650e1de-39db-4dff-a758-6c8f25a8ef26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c', 'volume_name': 'volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0936cd-d4b9-4b3a-955c-413c4ec9bec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0936cd-d4b9-4b3a-955c-413c4ec9bec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f3b4bcf-ac35-4beb-b90a-bb3f2e5d5846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:48:17 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Volume 48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c', 'volume_size': 1} Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-710273548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfe66188652442b6a0cfeeebb06c8e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:48:17Z,use_quota=True,user_id='62036f114ead40eda2fed66cae347072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)}" {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Creating volume 48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c {{(pid=86854) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:48:17 devstack cinder-volume[86854]: INFO cinder.volume.drivers.remotefs [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] casted to osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c 1073741824 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:48:17 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c 1073741824 Nov 06 14:48:17 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:48:17 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c 1073741824" returned: 0 in 0.417s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:48:17 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c Nov 06 14:48:17 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:48:17 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c" returned: 0 in 0.246s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'} {{(pid=86854) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f3b4bcf-ac35-4beb-b90a-bb3f2e5d5846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c', 'volume_size': 1}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f3dc486-f5a7-4726-becc-2acca7b29c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:48:17 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Volume volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c (48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c): created successfully Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f3dc486-f5a7-4726-becc-2acca7b29c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:48:17 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Flow 'volume_create_manager' (ff9e2ce1-5cc5-462d-9a9c-0f7f5ccbcdd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:48:17 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-9b596d09-4a63-471d-a718-bcf107fbfb4d tempest-SnapshotDependencyTests-1157708027 None] Created volume successfully. Nov 06 14:48:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e3209416-70a1-4f1c-8931-1155bae33816 tempest-SnapshotDependencyTests-1157708027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:48:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e3209416-70a1-4f1c-8931-1155bae33816 tempest-SnapshotDependencyTests-1157708027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:48:18 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-e3209416-70a1-4f1c-8931-1155bae33816 tempest-SnapshotDependencyTests-1157708027 None] Creating offline snapshot 7ecb8208-eeeb-415e-8f71-490c153e9dae of volume 48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c {{(pid=86854) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 14:48:18 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc67f4d6-a220-4276-92a7-c920eda579f6]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:48:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e3209416-70a1-4f1c-8931-1155bae33816 tempest-SnapshotDependencyTests-1157708027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:48:18 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c Nov 06 14:48:18 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:48:18 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Nov 06 14:48:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e3209416-70a1-4f1c-8931-1155bae33816 tempest-SnapshotDependencyTests-1157708027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c" returned: 0 in 0.353s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:48:18 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e3209416-70a1-4f1c-8931-1155bae33816 tempest-SnapshotDependencyTests-1157708027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.7ecb8208-eeeb-415e-8f71-490c153e9dae 1G {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:48:18 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.7ecb8208-eeeb-415e-8f71-490c153e9dae 1G Nov 06 14:48:18 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:48:19 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Nov 06 14:48:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e3209416-70a1-4f1c-8931-1155bae33816 tempest-SnapshotDependencyTests-1157708027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.7ecb8208-eeeb-415e-8f71-490c153e9dae 1G" returned: 0 in 0.404s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:48:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e3209416-70a1-4f1c-8931-1155bae33816 tempest-SnapshotDependencyTests-1157708027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.7ecb8208-eeeb-415e-8f71-490c153e9dae {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:48:19 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.7ecb8208-eeeb-415e-8f71-490c153e9dae Nov 06 14:48:19 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:48:19 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Nov 06 14:48:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e3209416-70a1-4f1c-8931-1155bae33816 tempest-SnapshotDependencyTests-1157708027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c -F qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.7ecb8208-eeeb-415e-8f71-490c153e9dae" returned: 0 in 0.280s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:48:19 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-e3209416-70a1-4f1c-8931-1155bae33816 tempest-SnapshotDependencyTests-1157708027 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.7ecb8208-eeeb-415e-8f71-490c153e9dae is being set with open permissions: ugo+rw Nov 06 14:48:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e3209416-70a1-4f1c-8931-1155bae33816 tempest-SnapshotDependencyTests-1157708027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.7ecb8208-eeeb-415e-8f71-490c153e9dae {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:48:19 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.7ecb8208-eeeb-415e-8f71-490c153e9dae Nov 06 14:48:19 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:48:19 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Nov 06 14:48:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e3209416-70a1-4f1c-8931-1155bae33816 tempest-SnapshotDependencyTests-1157708027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.7ecb8208-eeeb-415e-8f71-490c153e9dae" returned: 0 in 0.239s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:48:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e3209416-70a1-4f1c-8931-1155bae33816 tempest-SnapshotDependencyTests-1157708027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:48:19 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.info Nov 06 14:48:19 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:48:19 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Nov 06 14:48:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e3209416-70a1-4f1c-8931-1155bae33816 tempest-SnapshotDependencyTests-1157708027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.info" returned: 0 in 0.247s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:48:19 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-e3209416-70a1-4f1c-8931-1155bae33816 tempest-SnapshotDependencyTests-1157708027 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.info is being set with open permissions: ugo+rw Nov 06 14:48:19 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e3209416-70a1-4f1c-8931-1155bae33816 tempest-SnapshotDependencyTests-1157708027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.info {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:48:19 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.info Nov 06 14:48:19 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:48:20 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Nov 06 14:48:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-e3209416-70a1-4f1c-8931-1155bae33816 tempest-SnapshotDependencyTests-1157708027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.info" returned: 0 in 0.245s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:48:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-e3209416-70a1-4f1c-8931-1155bae33816 tempest-SnapshotDependencyTests-1157708027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.853s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:48:20 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-e3209416-70a1-4f1c-8931-1155bae33816 tempest-SnapshotDependencyTests-1157708027 None] Create snapshot completed successfully Nov 06 14:48:20 devstack cinder-volume[86854]: DEBUG cinder.volume.flows.manager.create_volume [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86854) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 14:48:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Flow 'volume_create_manager' (9fd32109-6ee7-4870-984c-5a1739f66516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:48:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b2f6b15-53a1-4f2e-a530-f6b21f2287c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:48:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b2f6b15-53a1-4f2e-a530-f6b21f2287c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T13:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb11ae8-de0b-4767-9972-8df0a1f62233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfe66188652442b6a0cfeeebb06c8e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T13:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7ecb8208-eeeb-415e-8f71-490c153e9dae,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T13:48:21Z,use_quota=True,user_id='62036f114ead40eda2fed66cae347072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517917dc-ebdf-4c5c-88ba-536e3454e476),volume_type_id=517917dc-ebdf-4c5c-88ba-536e3454e476)' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:48:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c333eb-a61d-471d-915a-76b3cfa85e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:48:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c333eb-a61d-471d-915a-76b3cfa85e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:48:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f7c265-89f4-458c-b8e6-e2b525f87cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:48:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f7c265-89f4-458c-b8e6-e2b525f87cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7eb11ae8-de0b-4767-9972-8df0a1f62233', 'volume_name': 'volume-7eb11ae8-de0b-4767-9972-8df0a1f62233', 'volume_size': 1, 'snapshot_id': '7ecb8208-eeeb-415e-8f71-490c153e9dae'}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:48:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da7e12dd-4248-4317-9baf-a6d8656b8b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:48:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da7e12dd-4248-4317-9baf-a6d8656b8b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:48:20 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a02835-022b-4e89-aab8-a159e9a23401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:48:20 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Volume 7eb11ae8-de0b-4767-9972-8df0a1f62233: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7eb11ae8-de0b-4767-9972-8df0a1f62233', 'volume_size': 1, 'snapshot_id': '7ecb8208-eeeb-415e-8f71-490c153e9dae'} Nov 06 14:48:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:48:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:48:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Acquiring lock "cinder-quobyte-7ecb8208-eeeb-415e-8f71-490c153e9dae-7eb11ae8-de0b-4767-9972-8df0a1f62233" by "_create_volume_from_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:48:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Lock "cinder-quobyte-7ecb8208-eeeb-415e-8f71-490c153e9dae-7eb11ae8-de0b-4767-9972-8df0a1f62233" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:48:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Creating volume 7eb11ae8-de0b-4767-9972-8df0a1f62233 from snapshot 7ecb8208-eeeb-415e-8f71-490c153e9dae {{(pid=86854) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 14:48:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:48:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:48:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:48:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:48:20 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:48:20 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Selected osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e as target Quobyte volume. {{(pid=86854) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 14:48:20 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Acquiring lock "cinder-quobyte-7eb11ae8-de0b-4767-9972-8df0a1f62233" by "_copy_volume_from_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:48:21 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Lock "cinder-quobyte-7eb11ae8-de0b-4767-9972-8df0a1f62233" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:48:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] snapshot: 7ecb8208-eeeb-415e-8f71-490c153e9dae, volume: 7eb11ae8-de0b-4767-9972-8df0a1f62233, {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 14:48:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:48:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:48:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:48:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:48:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:48:21 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8ab0a4-b9f9-4e32-9c48-7db81234b44f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:48:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.7ecb8208-eeeb-415e-8f71-490c153e9dae {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:48:21 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.7ecb8208-eeeb-415e-8f71-490c153e9dae Nov 06 14:48:21 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:48:21 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Nov 06 14:48:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.7ecb8208-eeeb-415e-8f71-490c153e9dae" returned: 0 in 0.354s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:48:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:48:21 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[e960cfb4-75c8-437c-86c2-ae0b8599946d]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:48:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:48:21 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c Nov 06 14:48:21 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:48:21 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Nov 06 14:48:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c" returned: 0 in 0.344s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:48:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 14:48:21 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Creating direct copy from snapshot {{(pid=86854) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 14:48:21 devstack cinder-volume[86854]: DEBUG cinder.utils [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Path /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7eb11ae8-de0b-4767-9972-8df0a1f62233 not found in is_blk_device check {{(pid=86854) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 14:48:21 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7eb11ae8-de0b-4767-9972-8df0a1f62233 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:48:21 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7eb11ae8-de0b-4767-9972-8df0a1f62233 Nov 06 14:48:21 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:48:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:48:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:48:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:48:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:48:23 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:48:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:48:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:48:23 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:48:23 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:48:23 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Nov 06 14:48:23 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.337s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:48:23 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:48:23 devstack cinder-volume[86854]: DEBUG oslo_service.periodic_task [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] Running periodic task VolumeManager._thread_info {{(pid=86854) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 14:48:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread count: 28 {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 14:48:23 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-640b8925-56ab-42c2-bda9-c379101945f8 None None] thread info: [<_MainThread(MainThread, started 130306900594816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86854) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 14:48:27 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Nov 06 14:48:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7eb11ae8-de0b-4767-9972-8df0a1f62233" returned: 0 in 5.901s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:48:27 devstack cinder-volume[86854]: DEBUG cinder.image.image_utils [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Image conversion details: src /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c, size 1024.00 MB, duration 5.90 sec, destination /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7eb11ae8-de0b-4767-9972-8df0a1f62233 {{(pid=86854) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 14:48:27 devstack cinder-volume[86854]: INFO cinder.image.image_utils [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Converted 1024.00 MB image at 173.51 MB/s Nov 06 14:48:27 devstack cinder-volume[86854]: WARNING cinder.volume.drivers.remotefs [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7eb11ae8-de0b-4767-9972-8df0a1f62233 is being set with open permissions: ugo+rw Nov 06 14:48:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7eb11ae8-de0b-4767-9972-8df0a1f62233 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:48:27 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7eb11ae8-de0b-4767-9972-8df0a1f62233 Nov 06 14:48:27 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:48:27 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Nov 06 14:48:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7eb11ae8-de0b-4767-9972-8df0a1f62233" returned: 0 in 0.238s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:48:27 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Lock "cinder-quobyte-7eb11ae8-de0b-4767-9972-8df0a1f62233" released by "_copy_volume_from_snapshot" :: held 6.923s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:48:27 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Lock "cinder-quobyte-7ecb8208-eeeb-415e-8f71-490c153e9dae-7eb11ae8-de0b-4767-9972-8df0a1f62233" released by "_create_volume_from_snapshot" :: held 6.995s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:48:27 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.016s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:48:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a02835-022b-4e89-aab8-a159e9a23401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eb11ae8-de0b-4767-9972-8df0a1f62233', 'volume_size': 1, 'snapshot_id': '7ecb8208-eeeb-415e-8f71-490c153e9dae'}' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:48:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f12f5f60-a97b-41c9-85d1-9f3dd14fcb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 14:48:28 devstack cinder-volume[86854]: INFO cinder.volume.flows.manager.create_volume [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Volume volume-7eb11ae8-de0b-4767-9972-8df0a1f62233 (7eb11ae8-de0b-4767-9972-8df0a1f62233): created successfully Nov 06 14:48:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f12f5f60-a97b-41c9-85d1-9f3dd14fcb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86854) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 14:48:28 devstack cinder-volume[86854]: DEBUG cinder.volume.manager [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Flow 'volume_create_manager' (9fd32109-6ee7-4870-984c-5a1739f66516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86854) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 14:48:28 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-754ee501-f6c6-41c7-ad4a-1d4ab6128bb5 tempest-SnapshotDependencyTests-1157708027 None] Created volume successfully. Nov 06 14:48:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bf4cb440-1691-40de-a565-e117ec69f0ba tempest-SnapshotDependencyTests-1157708027 None] Acquiring lock "cinder-7ecb8208-eeeb-415e-8f71-490c153e9dae-delete_snapshot" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:48:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bf4cb440-1691-40de-a565-e117ec69f0ba tempest-SnapshotDependencyTests-1157708027 None] Lock "cinder-7ecb8208-eeeb-415e-8f71-490c153e9dae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:48:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bf4cb440-1691-40de-a565-e117ec69f0ba tempest-SnapshotDependencyTests-1157708027 None] Acquiring lock "cinder-quobyte-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c" by "delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:48:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bf4cb440-1691-40de-a565-e117ec69f0ba tempest-SnapshotDependencyTests-1157708027 None] Lock "cinder-quobyte-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:48:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bf4cb440-1691-40de-a565-e117ec69f0ba tempest-SnapshotDependencyTests-1157708027 None] Acquiring lock "cinder-quobyte-7ecb8208-eeeb-415e-8f71-490c153e9dae" by "_delete_snapshot" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:48:28 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bf4cb440-1691-40de-a565-e117ec69f0ba tempest-SnapshotDependencyTests-1157708027 None] Lock "cinder-quobyte-7ecb8208-eeeb-415e-8f71-490c153e9dae" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:48:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-bf4cb440-1691-40de-a565-e117ec69f0ba tempest-SnapshotDependencyTests-1157708027 None] Deleting offline snapshot 7ecb8208-eeeb-415e-8f71-490c153e9dae of volume 48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 14:48:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-bf4cb440-1691-40de-a565-e117ec69f0ba tempest-SnapshotDependencyTests-1157708027 None] snapshot_file for this snap is: volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.7ecb8208-eeeb-415e-8f71-490c153e9dae {{(pid=86854) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 14:48:28 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aaa7a28-bb1f-4a20-be78-ef9018fe3948]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:48:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bf4cb440-1691-40de-a565-e117ec69f0ba tempest-SnapshotDependencyTests-1157708027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.7ecb8208-eeeb-415e-8f71-490c153e9dae {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:48:28 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.7ecb8208-eeeb-415e-8f71-490c153e9dae Nov 06 14:48:28 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:48:28 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Nov 06 14:48:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bf4cb440-1691-40de-a565-e117ec69f0ba tempest-SnapshotDependencyTests-1157708027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.7ecb8208-eeeb-415e-8f71-490c153e9dae" returned: 0 in 0.347s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:48:28 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.remotefs [None req-bf4cb440-1691-40de-a565-e117ec69f0ba tempest-SnapshotDependencyTests-1157708027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86854) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 14:48:28 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d434e6d-9f13-4947-b9fe-46c01cd19297]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:48:28 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bf4cb440-1691-40de-a565-e117ec69f0ba tempest-SnapshotDependencyTests-1157708027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:48:28 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c Nov 06 14:48:28 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:48:29 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Nov 06 14:48:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bf4cb440-1691-40de-a565-e117ec69f0ba tempest-SnapshotDependencyTests-1157708027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c" returned: 0 in 0.536s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:48:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bf4cb440-1691-40de-a565-e117ec69f0ba tempest-SnapshotDependencyTests-1157708027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.7ecb8208-eeeb-415e-8f71-490c153e9dae {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:48:29 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.7ecb8208-eeeb-415e-8f71-490c153e9dae Nov 06 14:48:29 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:48:29 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Nov 06 14:48:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bf4cb440-1691-40de-a565-e117ec69f0ba tempest-SnapshotDependencyTests-1157708027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.7ecb8208-eeeb-415e-8f71-490c153e9dae" returned: 0 in 0.318s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:48:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bf4cb440-1691-40de-a565-e117ec69f0ba tempest-SnapshotDependencyTests-1157708027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.7ecb8208-eeeb-415e-8f71-490c153e9dae {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:48:29 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.7ecb8208-eeeb-415e-8f71-490c153e9dae Nov 06 14:48:29 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:48:29 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Nov 06 14:48:29 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-bf4cb440-1691-40de-a565-e117ec69f0ba tempest-SnapshotDependencyTests-1157708027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c.7ecb8208-eeeb-415e-8f71-490c153e9dae" returned: 0 in 0.244s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:48:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bf4cb440-1691-40de-a565-e117ec69f0ba tempest-SnapshotDependencyTests-1157708027 None] Lock "cinder-quobyte-7ecb8208-eeeb-415e-8f71-490c153e9dae" released by "_delete_snapshot" :: held 1.550s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:48:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bf4cb440-1691-40de-a565-e117ec69f0ba tempest-SnapshotDependencyTests-1157708027 None] Lock "cinder-quobyte-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c" released by "delete_snapshot" :: held 1.571s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:48:30 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-bf4cb440-1691-40de-a565-e117ec69f0ba tempest-SnapshotDependencyTests-1157708027 None] Created reservations ['e80546cd-2907-49c5-9d40-7307ca0baacb', 'c03d953d-cd05-4aa0-9db8-51b2b903bbd6', '35754b5d-4894-40cb-a793-79b2f16866e8', '75c925f6-2f66-4f48-bea7-e3943444b456'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:48:30 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-bf4cb440-1691-40de-a565-e117ec69f0ba tempest-SnapshotDependencyTests-1157708027 None] Delete snapshot completed successfully. Nov 06 14:48:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-bf4cb440-1691-40de-a565-e117ec69f0ba tempest-SnapshotDependencyTests-1157708027 None] Lock "cinder-7ecb8208-eeeb-415e-8f71-490c153e9dae-delete_snapshot" released by "delete_snapshot" :: held 1.695s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:48:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-cef776cb-ade7-4f52-b8e4-6222266c55f2 tempest-SnapshotDependencyTests-1157708027 None] Acquiring lock "cinder-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:48:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-cef776cb-ade7-4f52-b8e4-6222266c55f2 tempest-SnapshotDependencyTests-1157708027 None] Lock "cinder-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:48:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-cef776cb-ade7-4f52-b8e4-6222266c55f2 tempest-SnapshotDependencyTests-1157708027 None] Acquiring lock "cinder-quobyte-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:48:30 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-cef776cb-ade7-4f52-b8e4-6222266c55f2 tempest-SnapshotDependencyTests-1157708027 None] Lock "cinder-quobyte-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c" acquired by "delete_volume" :: waited 0.014s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:48:30 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ce64bc-2a47-4b32-ad3a-8699c4836a5e]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:48:30 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cef776cb-ade7-4f52-b8e4-6222266c55f2 tempest-SnapshotDependencyTests-1157708027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:48:30 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c Nov 06 14:48:30 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:48:31 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Nov 06 14:48:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cef776cb-ade7-4f52-b8e4-6222266c55f2 tempest-SnapshotDependencyTests-1157708027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c" returned: 0 in 0.359s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:48:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cef776cb-ade7-4f52-b8e4-6222266c55f2 tempest-SnapshotDependencyTests-1157708027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:48:31 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c Nov 06 14:48:31 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:48:31 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Nov 06 14:48:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cef776cb-ade7-4f52-b8e4-6222266c55f2 tempest-SnapshotDependencyTests-1157708027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c" returned: 0 in 0.243s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:48:31 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-cef776cb-ade7-4f52-b8e4-6222266c55f2 tempest-SnapshotDependencyTests-1157708027 None] Lock "cinder-quobyte-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c" released by "delete_volume" :: held 0.662s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:48:31 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-cef776cb-ade7-4f52-b8e4-6222266c55f2 tempest-SnapshotDependencyTests-1157708027 None] Created reservations ['61cbd2b9-b33e-40a1-947e-9678f73e68f9', '7f535746-57d0-4408-8d2b-d2c5f1efedc1', '784cfaf9-267e-4428-96ca-daa42c6b7712', 'ffda1ee5-218a-4eba-aa17-69644c9bc0f8'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:48:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-cef776cb-ade7-4f52-b8e4-6222266c55f2 tempest-SnapshotDependencyTests-1157708027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:48:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-cef776cb-ade7-4f52-b8e4-6222266c55f2 tempest-SnapshotDependencyTests-1157708027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:48:31 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-cef776cb-ade7-4f52-b8e4-6222266c55f2 tempest-SnapshotDependencyTests-1157708027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:48:31 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-cef776cb-ade7-4f52-b8e4-6222266c55f2 tempest-SnapshotDependencyTests-1157708027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:48:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-cef776cb-ade7-4f52-b8e4-6222266c55f2 tempest-SnapshotDependencyTests-1157708027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:48:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cef776cb-ade7-4f52-b8e4-6222266c55f2 tempest-SnapshotDependencyTests-1157708027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:48:31 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:48:31 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:48:31 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Nov 06 14:48:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-cef776cb-ade7-4f52-b8e4-6222266c55f2 tempest-SnapshotDependencyTests-1157708027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.247s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:48:31 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-cef776cb-ade7-4f52-b8e4-6222266c55f2 tempest-SnapshotDependencyTests-1157708027 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:48:31 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-cef776cb-ade7-4f52-b8e4-6222266c55f2 tempest-SnapshotDependencyTests-1157708027 None] Deleted volume successfully. Nov 06 14:48:31 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-cef776cb-ade7-4f52-b8e4-6222266c55f2 tempest-SnapshotDependencyTests-1157708027 None] Lock "cinder-48ff9d45-5cf4-48b7-a4a3-5ccca1eaa30c-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:48:31 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3304a459-855f-4e48-b345-1583e9c9c3d4 tempest-SnapshotDependencyTests-1157708027 None] Acquiring lock "cinder-7eb11ae8-de0b-4767-9972-8df0a1f62233-delete_volume" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:48:31 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3304a459-855f-4e48-b345-1583e9c9c3d4 tempest-SnapshotDependencyTests-1157708027 None] Lock "cinder-7eb11ae8-de0b-4767-9972-8df0a1f62233-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:48:31 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3304a459-855f-4e48-b345-1583e9c9c3d4 tempest-SnapshotDependencyTests-1157708027 None] Acquiring lock "cinder-quobyte-7eb11ae8-de0b-4767-9972-8df0a1f62233" by "delete_volume" {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 14:48:31 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3304a459-855f-4e48-b345-1583e9c9c3d4 tempest-SnapshotDependencyTests-1157708027 None] Lock "cinder-quobyte-7eb11ae8-de0b-4767-9972-8df0a1f62233" acquired by "delete_volume" :: waited 0.013s {{(pid=86854) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 14:48:31 devstack cinder-volume[86854]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5a16fd-7635-4c8e-9aac-ac00fec11f33]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 14:48:31 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3304a459-855f-4e48-b345-1583e9c9c3d4 tempest-SnapshotDependencyTests-1157708027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7eb11ae8-de0b-4767-9972-8df0a1f62233 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:48:31 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7eb11ae8-de0b-4767-9972-8df0a1f62233 Nov 06 14:48:31 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:48:32 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Nov 06 14:48:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3304a459-855f-4e48-b345-1583e9c9c3d4 tempest-SnapshotDependencyTests-1157708027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7eb11ae8-de0b-4767-9972-8df0a1f62233" returned: 0 in 0.350s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:48:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3304a459-855f-4e48-b345-1583e9c9c3d4 tempest-SnapshotDependencyTests-1157708027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7eb11ae8-de0b-4767-9972-8df0a1f62233 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:48:32 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7eb11ae8-de0b-4767-9972-8df0a1f62233 Nov 06 14:48:32 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:48:32 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Nov 06 14:48:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3304a459-855f-4e48-b345-1583e9c9c3d4 tempest-SnapshotDependencyTests-1157708027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795/volume-7eb11ae8-de0b-4767-9972-8df0a1f62233" returned: 0 in 0.245s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:48:32 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3304a459-855f-4e48-b345-1583e9c9c3d4 tempest-SnapshotDependencyTests-1157708027 None] Lock "cinder-quobyte-7eb11ae8-de0b-4767-9972-8df0a1f62233" released by "delete_volume" :: held 0.636s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:48:32 devstack cinder-volume[86854]: DEBUG cinder.quota [None req-3304a459-855f-4e48-b345-1583e9c9c3d4 tempest-SnapshotDependencyTests-1157708027 None] Created reservations ['d6f8e4cb-e376-4def-b2df-28ed025ea2d5', '3e92b60e-86fc-4201-8aed-9375c9b2c7c8', '5a767a3b-3936-43aa-b77a-93a4d2dd4564', '6193fad9-f529-4b70-85d2-439fe1e40805'] {{(pid=86854) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 14:48:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3304a459-855f-4e48-b345-1583e9c9c3d4 tempest-SnapshotDependencyTests-1157708027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 14:48:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3304a459-855f-4e48-b345-1583e9c9c3d4 tempest-SnapshotDependencyTests-1157708027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 14:48:32 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3304a459-855f-4e48-b345-1583e9c9c3d4 tempest-SnapshotDependencyTests-1157708027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e': None} {{(pid=86854) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 14:48:32 devstack cinder-volume[86854]: DEBUG cinder.volume.drivers.quobyte [None req-3304a459-855f-4e48-b345-1583e9c9c3d4 tempest-SnapshotDependencyTests-1157708027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cb267ea7-0819-42a0-8d07-f62c1780f29e'] {{(pid=86854) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 14:48:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.lockutils [None req-3304a459-855f-4e48-b345-1583e9c9c3d4 tempest-SnapshotDependencyTests-1157708027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86854) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 14:48:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3304a459-855f-4e48-b345-1583e9c9c3d4 tempest-SnapshotDependencyTests-1157708027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 14:48:32 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795 Nov 06 14:48:32 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 14:48:32 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Nov 06 14:48:32 devstack cinder-volume[86854]: DEBUG oslo_concurrency.processutils [None req-3304a459-855f-4e48-b345-1583e9c9c3d4 tempest-SnapshotDependencyTests-1157708027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13f5006af386c5ab9630c8266903c795" returned: 0 in 0.236s {{(pid=86854) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 14:48:32 devstack cinder-volume[86854]: DEBUG cinder.manager [None req-3304a459-855f-4e48-b345-1583e9c9c3d4 tempest-SnapshotDependencyTests-1157708027 None] Notifying Schedulers of capabilities ... {{(pid=86854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 14:48:32 devstack cinder-volume[86854]: INFO cinder.volume.manager [None req-3304a459-855f-4e48-b345-1583e9c9c3d4 tempest-SnapshotDependencyTests-1157708027 None] Deleted volume successfully. Nov 06 14:48:32 devstack cinder-volume[86854]: DEBUG cinder.coordination [None req-3304a459-855f-4e48-b345-1583e9c9c3d4 tempest-SnapshotDependencyTests-1157708027 None] Lock "cinder-7eb11ae8-de0b-4767-9972-8df0a1f62233-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=86854) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 14:48:42 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=26,cinder:UPDATE=28,cinder:INSERT=9,cinder:DELETE=1 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 14:48:42 devstack cinder-volume[86854]: DEBUG dbcounter [-] [86854] Writing DB stats cinder:SELECT=23,cinder:UPDATE=30,cinder:DELETE=4,cinder:INSERT=6 {{(pid=86854) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}